-- Logs begin at Wed 2022-08-24 02:43:14 UTC, end at Wed 2022-08-24 04:12:06 UTC. -- Aug 24 03:25:03.489715 dv-cinder-854259-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 03:25:03.500017 dv-cinder-854259-1-smb devstack@keystone.service[81697]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:25:03 2022] *** Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: nodename: dv-cinder-854259-1-smb Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: machine: x86_64 Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: clock source: unix Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: pcre jit disabled Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: detected number of CPU cores: 4 Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: current working directory: / Aug 24 03:25:03.502000 dv-cinder-854259-1-smb devstack@keystone.service[81697]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: your processes number limit is 47680 Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: your memory page size is 4096 bytes Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: detected max file descriptor number: 2048 Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: lock engine: pthread robust mutexes Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: thunder lock: enabled Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 03:25:03.502558 dv-cinder-854259-1-smb devstack@keystone.service[81697]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:25:03.542659 dv-cinder-854259-1-smb devstack@keystone.service[81697]: Python main interpreter initialized at 0x564b0340a9c0 Aug 24 03:25:03.542659 dv-cinder-854259-1-smb devstack@keystone.service[81697]: python threads support enabled Aug 24 03:25:03.542659 dv-cinder-854259-1-smb devstack@keystone.service[81697]: your server socket listen backlog is limited to 100 connections Aug 24 03:25:03.542659 dv-cinder-854259-1-smb devstack@keystone.service[81697]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:25:03.543025 dv-cinder-854259-1-smb devstack@keystone.service[81697]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:25:03.543105 dv-cinder-854259-1-smb devstack@keystone.service[81697]: *** Operational MODE: preforking *** Aug 24 03:25:03.543410 dv-cinder-854259-1-smb devstack@keystone.service[81697]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:25:03.543410 dv-cinder-854259-1-smb devstack@keystone.service[81697]: spawned uWSGI master process (pid: 81697) Aug 24 03:25:03.543616 dv-cinder-854259-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 03:25:03.547245 dv-cinder-854259-1-smb devstack@keystone.service[81697]: spawned uWSGI worker 1 (pid: 81740, cores: 1) Aug 24 03:25:03.547245 dv-cinder-854259-1-smb devstack@keystone.service[81697]: spawned uWSGI worker 2 (pid: 81741, cores: 1) Aug 24 03:25:03.547245 dv-cinder-854259-1-smb devstack@keystone.service[81697]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:25:07.920941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:07.920941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Aug 24 03:25:07.921710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:07.921710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: from cryptography.utils import int_from_bytes Aug 24 03:25:07.921820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:07.921820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: from cryptography.utils import int_from_bytes Aug 24 03:25:07.921820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:07.921820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: from cryptography.utils import int_from_bytes Aug 24 03:25:07.971374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:07.971512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:07.971630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:07.971728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] command line args: [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:07.971811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:07.971935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:07.972019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] command line args: [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:07.972122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ================================================================================ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:07.972266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:07.972376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.972466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ================================================================================ {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:07.973139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_dir = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] admin_token = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] config_source = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] config_dir = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] debug = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.973870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] config_source = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] debug = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.974923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_config_append = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_config_append = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_dir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.975941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_dir = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_file = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.976980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.977920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.978910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] publish_errors = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.979918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] publish_errors = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.980993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] standard_threads = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] standard_threads = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.981857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_journal = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_json = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] use_journal = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_stderr = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] use_json = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] use_syslog = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] use_stderr = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.982952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] use_syslog = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.983034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.983187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:07.983264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.983996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.984960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.985949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.986937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.987912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.988070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.988152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.988866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.988965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.989962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.990888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.991994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.992929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.993953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.994996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.995934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.996951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.997909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.998878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:07.999985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.000971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.001913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.002978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.003951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.004935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.005872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.006988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.007950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.external = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.008923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.external = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.password = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.009911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] auth.token = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.password = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] auth.token = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.010981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.011927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.012901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.013917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.014900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.015885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.016997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.017987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.018956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.019949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.020987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.021955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.022944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.023922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.024851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.025986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.026946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.027969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.028966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.029918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.030986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.031938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.032914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.033841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.034988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.035573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.035756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.035838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.035989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.036938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.037989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.038956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.039909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.040854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.041975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042639 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.042895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] role.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] role.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.043928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.044977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.045876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.046945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.047977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.048981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.049885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.050037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.050415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.050559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.050725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.051368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.051502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.051629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.051759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.051896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.052939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.053993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.054119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.054572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.054699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.054824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.054948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.055976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.056981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.057884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058346 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.connection = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058619 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.058888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.059940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.060923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81741) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:08.061946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.061946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:08.089024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.089187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.089273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.089424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.089507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.089650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.098492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.098698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.127207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.127436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.127776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.128013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.181465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.181632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.230911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.231095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.231195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.231383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.388892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.389055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.389200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.389308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.389411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.389514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.422920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.423706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.435160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.435374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.455923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.456564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81741) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.473341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.473537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.473623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.473757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.473912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.474128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.474222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.474341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.474426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.474599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.474899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.475123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.475206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.475395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.475487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.475665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.485964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.486181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.493379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.493782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.496345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.496626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.496710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.496909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.497826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.498958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.499038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.499230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.499323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.499529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.522667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.522850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.524135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.524333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.524432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.524627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.529133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.529327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.529412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.529617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.529702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.529908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.536598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.536880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.536964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.537314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.541106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.541279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.541401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.541576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.541695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.541866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.541997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.542861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.543017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.543133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.543292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.560239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.560405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.560519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.560700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.564419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.564591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.568148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.568382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.568467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.568685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.572657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.572907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.575805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.576090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.579060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.579362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.579445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.579648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.579747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.579938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.580808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.596871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.597158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.597243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.597429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.597525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.597735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.597820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.598035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.604631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.604947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.606194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.606476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.606558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.606790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.609365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.609650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.609732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.609956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.610832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.621871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.622180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.622264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.622461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.622545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.622743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.622828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623584 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.623888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.639433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.639954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.642502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.643021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.646004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.646532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.647457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.647990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.648932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.649219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.649480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.649609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.649771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.650092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.655985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.656607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.657462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.658087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.660465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.660760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.661952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.669763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.670126 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.670295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.670433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.670698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.670782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.677674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.677977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.678271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.678579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.678850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.679124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.679403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.679605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81741) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.679724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.679895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.680924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.681746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.682052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.682326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.682598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.682872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.683132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81741) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.716633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564b0340a9c0 pid: 81740 (default app) Aug 24 03:25:08.718043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564b0340a9c0 pid: 81741 (default app) Aug 24 03:25:08.720101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59b0a-c467-4424-b18f-30ebcc388fb0 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:08.720393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59b0a-c467-4424-b18f-30ebcc388fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:08.720672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59b0a-c467-4424-b18f-30ebcc388fb0 None None] PATH_INFO: `/v3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:08.725214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Aug 24 03:25:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:16.420509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.421019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.421103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.425383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:16.432795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.433171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.433410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.505093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: INFO dbcounter [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] Registered counter for database keystone Aug 24 03:25:16.524208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG oslo_db.sqlalchemy.engines [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:16.530377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writer thread running {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:16.710499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG passlib.handlers.bcrypt [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81740) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:16.710924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG passlib.handlers.bcrypt [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81740) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:16.766104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:16.767725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:16.895540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 03:25:17.352291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:17.421248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: INFO dbcounter [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] Registered counter for database keystone Aug 24 03:25:17.442422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:17.448637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writer thread running {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:17.569171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea66d57-e66d-488c-9bcd-544a33e2e6ed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:17.573466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:17.574116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:17.574399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:17.574676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:17.583246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:17.635110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:17.635408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2cd74-2f94-4002-928c-22b41f9d5f8a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:17.644860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:17.650979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:17.665629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a8cbf-28e2-491d-8421-7266d4e676df None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:17.670111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:17.671214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:17.671539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:17.671770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] PATH_INFO: `/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:17.673339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] RBAC: Authorizing `identity:get_project(project_id=bcc2c09443be4848acb9a6d8fb8bb990)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:17.726466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:17.726814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038342b-24fd-423e-9f1d-d4e01e33b63a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:17.731349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Aug 24 03:25:17 2022] GET /identity/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:19.657440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663c4e-9874-416f-847a-3967759c812b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:19.657975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663c4e-9874-416f-847a-3967759c812b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:19.658059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663c4e-9874-416f-847a-3967759c812b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:19.662749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:19.668204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:19.668565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:19.668763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:19.688833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:19.690381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:19.698862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:25:19.971630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1663c4e-9874-416f-847a-3967759c812b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:19.984570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1663c4e-9874-416f-847a-3967759c812b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:19.988933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:19.990195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:19.990482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:19.990755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:19.998663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:20.000444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718952f7-ec18-452f-94c0-c8a0c0a02b48 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:20.009357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:20.014675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:20.023743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2763453-daf1-4596-a230-c1f9ee21cb17 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:20.028055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:20.028673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:20.028951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:20.029223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:20.030533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:20.032342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc559c-07a1-4d98-8fb2-814b397597d2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:20.033841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Aug 24 03:25:20 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:21.973122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ba61-cb10-4fe4-bfcc-6c5d258b3dd2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:21.973609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ba61-cb10-4fe4-bfcc-6c5d258b3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:21.973609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6ba61-cb10-4fe4-bfcc-6c5d258b3dd2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:21.975479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:21.980651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:21.981050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:21.981199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:21.999657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:22.000841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:22.044073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4487-0843-470e-8aa1-7bc78ca44a86 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.044352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4487-0843-470e-8aa1-7bc78ca44a86 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.044626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de4487-0843-470e-8aa1-7bc78ca44a86 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.045959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:22.051026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.051689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.051975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.079884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:22.094048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81741) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:22.094466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG passlib.handlers.bcrypt [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81741) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:22.140484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:22.142089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:22.238947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:22.343162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.367788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.445290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825282e8-5fc0-4e24-b277-a161c00e5eda None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.478107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.478734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.479012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.479287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.490507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:22.499024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:22.499943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:22.500691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:22.505901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.506304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.587753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.606666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2d37-905e-440f-bfe4-5681d9645ec3 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.609201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b7cf-47ec-41c4-a4c0-08583174e069 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.612305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.640145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.640755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.641052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.641314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.645469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.646872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.647149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.647416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.648242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:22.648541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.650017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.662142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:22.667580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.713062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.714660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.769692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5c302-31bb-4577-84f5-0f43e614e0c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.795256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.803374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.804225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.804509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.809222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.809222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.809222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.809222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:22.813968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:22.814756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.819558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.849545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.914763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa8084-8fee-406d-9927-209fd92b0d76 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.916564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fd89e-807c-4904-9a92-e7663dddbf1a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.948402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.949024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.949340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.949572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.949909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.950557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.950769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.950858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.951091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.952225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.953774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:22.960068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.961451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.962947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:22.978462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:22.979529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:22.980658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:22.980658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:22.980658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:22.980658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:22.985326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.019602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.067047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103efa7-36df-4e8c-a160-e04ebacf97e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.067047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.085749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b81e-525a-46cf-85f2-aa76c67a1538 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.096229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.096827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.097103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.097375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.098162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.domain.id=default, user.id=04db7b67b37f41558e8d4c57ad2b3f70) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:23.098468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.100412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f629f-ec0f-4e38-99f0-3e9aa3fb4652 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.109409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/role_assignments?user.id=04db7b67b37f41558e8d4c57ad2b3f70&scope.domain.id=default&role.id=15131bc73ffe4de98028e781cae256f3 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:23.120795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.121443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.121726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.122037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.122714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:23.123030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.124476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e52e-382c-4a25-b0d3-d80dde8b1316 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.144125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:25.172150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16bb6a-726b-4c64-9f47-cc02330f7361 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.172696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16bb6a-726b-4c64-9f47-cc02330f7361 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.172696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16bb6a-726b-4c64-9f47-cc02330f7361 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.174042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:25.179365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0a8c-56f4-4e26-88eb-b3bc81b80a4d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.180237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0a8c-56f4-4e26-88eb-b3bc81b80a4d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.180758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f0a8c-56f4-4e26-88eb-b3bc81b80a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.206957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c74f0a8c-56f4-4e26-88eb-b3bc81b80a4d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:25.209066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c74f0a8c-56f4-4e26-88eb-b3bc81b80a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.289188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:25.464172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6c11-bef7-4833-9e95-bfa415d393e1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.464770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6c11-bef7-4833-9e95-bfa415d393e1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.465248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6c11-bef7-4833-9e95-bfa415d393e1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.466847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:25.472197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.472728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.473217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.499193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:25.500745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.520267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:25.546104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafe09-00e0-44f4-86c9-bc1aa267d0b8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.546411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafe09-00e0-44f4-86c9-bc1aa267d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.546678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafe09-00e0-44f4-86c9-bc1aa267d0b8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.548506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 14/25] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:25.561245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.561817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.562305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.596049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:25.597383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:25.598869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.722017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:25.730893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:25.858218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc2450-1a0d-4928-9a75-1adedc647884 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:25.897463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:25.898124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.898408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.898684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.922850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:25.928172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:25.929015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:25.929792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:25.935231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.055813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.060491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.067953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338ca3c-de0f-41b2-ad49-078ecfb36a63 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.134337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.148696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.149313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.149593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.149915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.150660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:26.150965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.152348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.175799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:26.182641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.183251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d68f3-8866-49a8-90b9-66b64d847154 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.229852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.230515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.230801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.231077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.255125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.256681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-64cbe683-5ce1-4922-a26c-2779227ccdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:26.272127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:26.273178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:26.274088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:26.274088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:26.274088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:26.275748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 14/30] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:26.277047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c141-f8e1-48df-98da-49c3d8996de4 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.277481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c141-f8e1-48df-98da-49c3d8996de4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.277893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c141-f8e1-48df-98da-49c3d8996de4 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.279617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 15/31] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:26.280525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c141-f8e1-48df-98da-49c3d8996de4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.321601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488ff51-2c47-4137-9de2-4c0a9ce9588d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.360629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.361550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.362003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.362444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.363766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.365462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.367261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:26.367412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.368323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.401591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.409661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c141-f8e1-48df-98da-49c3d8996de4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.446738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.447602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.448036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.448490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.449305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.451011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.475462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aedc7-fa22-4b2d-a197-a9da3515498a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.512134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.512795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.513078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.513348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.514060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:26.514352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.515769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96984e-91d5-4d0a-85c8-77093834312c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.541845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:26.541845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.541845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.541845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.557997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:26.559177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:26.646770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 19/34] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:26.647665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.676041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.707484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/roles => generated 219 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:26.709524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.864044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc5306-ea01-4bc8-ae31-244e45413666 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.906654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.907655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.908172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.908661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.910107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.911865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.913710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 20/36] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:26.919778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.014448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.036761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e9a83-d32d-4221-a90f-32ff3aad60bf None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.087249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.088077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.088679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.089078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] PATH_INFO: `/v3/domains/default/users/04db7b67b37f41558e8d4c57ad2b3f70/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.091786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=04db7b67b37f41558e8d4c57ad2b3f70, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.093500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14698579-7f8d-4085-9d69-4ffc5b689217 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.094093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907f88-2eb1-4c42-b452-73863f0c3589 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.123953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.133022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.133638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.133921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.134225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.134919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.136509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.243875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 17/37] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/projects => generated 301 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:27.244625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.315329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 21/38] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Aug 24 03:25:26 2022] PUT /identity/v3/domains/default/users/04db7b67b37f41558e8d4c57ad2b3f70/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:25:27.317758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc76-4944-4d3f-963d-a3c25e62ae81 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.318146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc76-4944-4d3f-963d-a3c25e62ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.318467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394dc76-4944-4d3f-963d-a3c25e62ae81 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.330212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 22/39] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:27.330212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3447109-6881-463c-8733-bca7dd1ca23b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.330212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3447109-6881-463c-8733-bca7dd1ca23b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.330212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3447109-6881-463c-8733-bca7dd1ca23b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.330212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 23/40] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:27.331487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1c71-e213-47dd-b219-377d3ae80cde None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.331844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1c71-e213-47dd-b219-377d3ae80cde None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.332121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1c71-e213-47dd-b219-377d3ae80cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.355461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f70b1c71-e213-47dd-b219-377d3ae80cde None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:27.357225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f70b1c71-e213-47dd-b219-377d3ae80cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.424581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc51556-76ca-4001-a4af-921a234f8a56 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.454922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 24/41] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:27.457084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.457676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.457978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.473191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.474476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.474855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.475143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.475824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.477856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.480735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:27.482371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.564557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 18/42] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/roles => generated 225 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:27.572432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 25/43] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:27.743535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.784812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.845493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a18f5-ae61-4f78-a4fb-cc8043019eff None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.869092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.872655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.883420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.884560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.884763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.885181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.886052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.887620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.970163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c0c0-5c49-4136-916f-289cc4f50a32 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:28.002992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:28.003620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:28.003906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:28.004185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:28.005855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:28.014075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7e499-f2c7-421e-b693-c333028e9210 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:28.014225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 19/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:28.014333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 26/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:28.015808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:28.123701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:28.128423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba747-1f82-4b33-82fc-0a2092a8aa6e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:28.164673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:28.165349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:28.165634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:28.165917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:28.166624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:28.168096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637c441-40d4-4a73-b554-bd0e68d9e9ba None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:28.277384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 20/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:28 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:25:29.319040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8d15-42d2-4712-b852-e53a15181f94 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.319560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8d15-42d2-4712-b852-e53a15181f94 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.319642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8d15-42d2-4712-b852-e53a15181f94 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.320943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 27/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:29.326312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.326723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.326883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.345170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:29.346788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:29.415965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 21/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:29.689219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8d15-42d2-4712-b852-e53a15181f94 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:29.761090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:29.794555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8d15-42d2-4712-b852-e53a15181f94 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:29.828271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:29.828891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.829170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.829444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.841626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:29.849836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:29.850662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:29.851409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 28/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:29.856811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:29.935568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:29.954979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ede8f-308c-402a-a4c7-c13b916ad64d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:29.989521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:29.990666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.990949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.991222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.991889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:29.992189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:29.993576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.004559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 22/50] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.010647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.108744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc838e-9db8-4db4-ab6a-b290581a8079 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.138524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.143466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.144104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.144387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.144661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.145808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.147344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277643e-ba0d-4d5f-ab7e-2c4012a83003 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.148946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 29/51] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.155940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.199099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3c67-9c50-4388-9d93-d00938f07e17 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.199387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3c67-9c50-4388-9d93-d00938f07e17 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.199667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa3c67-9c50-4388-9d93-d00938f07e17 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.201013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 30/52] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:30.206166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.206400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.206682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.224806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:30.226033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:30.256603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1e33-7c5a-451c-b808-d74049e98acd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.290352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.290984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.291271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.294034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 31/53] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:30.294133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.294133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.294389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.296055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 23/54] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.301629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.397352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b904-4b69-4ff9-85f2-28341828ea25 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.426210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.432693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.435150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.435150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.435150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.435150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.domain.id=default, user.id=04db7b67b37f41558e8d4c57ad2b3f70) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:30.435150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.436484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.442157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 32/55] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/role_assignments?user.id=04db7b67b37f41558e8d4c57ad2b3f70&scope.domain.id=default&role.id=15131bc73ffe4de98028e781cae256f3 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.564831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.578399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.666917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033e70-984a-47b4-9b29-356059763e94 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.700423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.701056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.701358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.701615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.702754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.704209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5bf17-6896-4f46-8aa1-6b21621dac2b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.705775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 24/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.711987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.809099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af06a66-c648-4f21-b6ca-094b896ecbf7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.841491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.842054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.842339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.842615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.843246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.844685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec10e-ef3f-4688-92bd-b965206fe6de None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.955834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 33/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 24 03:25:30 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:32.850016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ebc97-40dc-4e82-84e5-c4192af2215c None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:32.850521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ebc97-40dc-4e82-84e5-c4192af2215c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:32.850632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ebc97-40dc-4e82-84e5-c4192af2215c None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:32.851917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 25/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:32.857215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:32.857851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:32.858060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:32.877457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:32.878700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:33.022964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:33.047540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 34/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:33.321564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ebc97-40dc-4e82-84e5-c4192af2215c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:33.398715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:33.420071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ebc97-40dc-4e82-84e5-c4192af2215c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:33.453411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:33.454051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:33.454330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:33.454599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:33.455695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:33.457168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8030-f6a8-42cc-89ea-53c9d402812d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:33.458783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 26/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:33.464401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:33.563827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ce473-9bba-43ab-b00f-411393aacc3a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:33.596322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:33.596862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:33.597141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:33.597415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:33.598090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:33.600167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd246fb-67c8-4a04-b7d7-7def4efd7186 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:33.721308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 35/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:33 2022] POST /identity/v3/users => generated 275 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:25:36.581286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c610c0-ae89-47d0-b5eb-ca5d1ed10ed1 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:36.581286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c610c0-ae89-47d0-b5eb-ca5d1ed10ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:36.581286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c610c0-ae89-47d0-b5eb-ca5d1ed10ed1 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:36.581286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 27/62] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:36.587669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eaab-94a5-4753-92ad-642dba23852a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:36.588447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eaab-94a5-4753-92ad-642dba23852a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:36.588907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eaab-94a5-4753-92ad-642dba23852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:36.615442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9db9eaab-94a5-4753-92ad-642dba23852a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:36.616919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9db9eaab-94a5-4753-92ad-642dba23852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:36.644688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:36.687978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 36/63] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:36.805525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2caf3-5e35-4b8c-93a9-cf7cdc54fb59 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:36.805855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2caf3-5e35-4b8c-93a9-cf7cdc54fb59 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:36.806122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2caf3-5e35-4b8c-93a9-cf7cdc54fb59 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:36.807661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 28/64] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:36.812738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8b1-4568-45fa-a4c4-b0ee4dca4d87 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:36.813038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8b1-4568-45fa-a4c4-b0ee4dca4d87 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:36.813325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcb8b1-4568-45fa-a4c4-b0ee4dca4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:36.835573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-40dcb8b1-4568-45fa-a4c4-b0ee4dca4d87 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:36.836703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-40dcb8b1-4568-45fa-a4c4-b0ee4dca4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:36.910570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 37/65] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.014474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2caf3-5e35-4b8c-93a9-cf7cdc54fb59 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.117269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081858-89f4-4c16-a7e6-5f9d22f0a105 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.117581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081858-89f4-4c16-a7e6-5f9d22f0a105 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.117837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e081858-89f4-4c16-a7e6-5f9d22f0a105 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.119216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 38/66] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:37.124989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.125277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.125558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.151261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.152472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.170986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2caf3-5e35-4b8c-93a9-cf7cdc54fb59 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.241229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.241877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.242187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.242464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.265295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:37.275054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:37.276878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:37.278086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 29/67] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:37.285046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 39/68] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.286052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.305853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.341398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.392850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.448493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecca92-b39f-4b38-bd12-b11cb3f5a271 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.496367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.496983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.497270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.497549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.498256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:37.498565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:37.500242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a24523-fbb4-4acb-b159-c0a15d8e1861 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:37.509308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 30/69] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:37.514446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2b7a-7404-4b97-818b-979ee85e2969 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.515423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2b7a-7404-4b97-818b-979ee85e2969 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.515850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a2b7a-7404-4b97-818b-979ee85e2969 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.517287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 31/70] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.517390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23ed59-961a-43c6-9273-f0fca13e1aad None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.518338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2b7a-7404-4b97-818b-979ee85e2969 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.559847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.560543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.560833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.561114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.572754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fbb48207-0a26-46c2-a0da-5d02af930b35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:37.578292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:37.579323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:37.580269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 40/71] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:37.582020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec562-5472-4ebc-aaa6-ce8e3dd37256 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.582322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec562-5472-4ebc-aaa6-ce8e3dd37256 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.582716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aec562-5472-4ebc-aaa6-ce8e3dd37256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.595713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.601808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5aec562-5472-4ebc-aaa6-ce8e3dd37256 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.603117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5aec562-5472-4ebc-aaa6-ce8e3dd37256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.633962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a2b7a-7404-4b97-818b-979ee85e2969 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.667592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.668190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.668473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.668751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.673206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 41/72] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.674502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068878-8fcf-49bf-80d5-a1ba8afe0aae None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.674796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068878-8fcf-49bf-80d5-a1ba8afe0aae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.675077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068878-8fcf-49bf-80d5-a1ba8afe0aae None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.676457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 42/73] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.677026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068878-8fcf-49bf-80d5-a1ba8afe0aae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.686508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:37.688076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:37.689799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 32/74] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:37.690660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.701587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.797854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068878-8fcf-49bf-80d5-a1ba8afe0aae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.804880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bbf3f-0af7-4174-9be9-37151e594b87 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.833111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.835749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.836361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.836672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.836943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.837616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:37.837919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:37.839345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c357647-56ee-449a-acaf-65043f73bff9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:37.842260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.842886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.843171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.843445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.853090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 43/75] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:37.853090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.853090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.853090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.858657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:37.863515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:37.864320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:37.865162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 33/76] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:37.865777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.874471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.876109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.952271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 44/77] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.953037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.956032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.977000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eade7ff-9092-4cea-a2f5-82efdbb89a69 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.015853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.016466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.016753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.017030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.056539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d8449-de11-41e6-afca-15344af03ce1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.074697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.088482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.090018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.095736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.096373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.096677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.096932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.098087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.100055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.105969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 45/78] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.105969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.171804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.197146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 34/79] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:38.198159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.206405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4129-181d-417f-9293-5d7294aa8e75 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.241797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.242433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.242718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.242995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.243661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:38.243966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.245356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.253079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 46/80] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.253862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.287843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.302359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fe2d6-56fc-4d9b-a813-4754e9471455 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.336361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.336985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.337267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.337545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.338676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.340125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.341729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 35/81] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.342528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.362068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dbac7-df29-4294-bc3b-07679c8eccd4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.394297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.394892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.395172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.395446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.398723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.440017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc94e-798b-4719-905a-e504f546ab26 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.463662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.465091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.473493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.474148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.474980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.475252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.476394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.477827 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.479668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 36/82] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.480327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.504878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.563863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 47/83] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:38.564806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.580186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94172-8a19-480d-99ea-1031bc415d80 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.600835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.615269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.615893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.616174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.616443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.626495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:38.631587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:38.632607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 37/84] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:38.634526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.668907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037e4b-be76-4660-aae4-c488996f4d58 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.703986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.704622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.704962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.705243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.706401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.707846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.709988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 48/85] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.710755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.718386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.735681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a65c-7aff-43eb-8d19-06e14a9db1ec None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.769770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.770605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.770894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.771186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.772355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.773823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.809500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9bceb-fee0-440d-b6da-ad14157539dd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.811029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.843373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.843976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.844256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.844527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.845243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:38.845547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.847124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.852363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 49/86] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.853131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.871766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 38/87] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:38 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:38.873520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.062269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d2ef-371c-4ed2-95bb-d0ec4f4fbf98 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.068192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea7689-0c86-4baf-8274-540db0b6cadb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.105573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.105573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.105853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.105930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.107142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.109268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.110692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 50/88] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.111360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.122509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.123145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.123427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.124215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.124903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:39.125628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.127415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.135491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.141024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 39/89] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.141427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.164141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.249517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd223e2-a491-4424-ade7-8044b1abe6cb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.266279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e1c6b-f4be-4c39-897a-f131a3f31107 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.290334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.291777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.292339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.292794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.309477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.310134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.310419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.310961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.312227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=04db7b67b37f41558e8d4c57ad2b3f70) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:39.312560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.314630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.329126 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 40/90] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/role_assignments?user.id=04db7b67b37f41558e8d4c57ad2b3f70&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.329914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.423368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.424895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.461898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.500615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.535696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb931-bce1-4e8e-89c0-105629af1ac5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.576965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.578133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.578647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.579119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.580494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.582181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.584383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 41/91] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.593394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.620913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 51/92] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:39.630165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.761913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748194-03ae-478a-9418-9b90ded8cf69 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.794790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.800541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.801165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.801498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.801779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.854749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45474b-dd1d-4e2c-83b2-a78616e89d88 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.912673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.914607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.959987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.961039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.961526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.962034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.966003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.967701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.969587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 52/93] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:39.976050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.984765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.065595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 42/94] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:40.072555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.103086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53559fc-19ac-4db7-9843-402a58f39eda None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.135011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.147911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.148838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.149348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.149828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.150798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:40.151330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.152985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.162375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 53/95] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:40.243122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5175da-5d14-4a58-8ec6-1170773421e4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.296527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.297533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.298044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.298548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] PATH_INFO: `/v3/projects/1d49adc9f6dd4931a559e1447bb2c383` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.299937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] RBAC: Authorizing `identity:get_project(project_id=1d49adc9f6dd4931a559e1447bb2c383)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.301648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d8b9c-125e-4721-9783-595fecb6b634 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.303662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 43/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/projects/1d49adc9f6dd4931a559e1447bb2c383 => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:40.310075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.382240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.420993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945ce2-3e59-42ee-98e0-8b2477950b23 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.459939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.460901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.461389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.461906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.462869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=1d49adc9f6dd4931a559e1447bb2c383, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:40.463382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.465031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196770f-376e-40c5-bd58-e05ca69697ad None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.471557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 54/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=1d49adc9f6dd4931a559e1447bb2c383&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:41.715475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1fc7-ac27-45fb-ba88-8eaaa2d0bda1 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.716410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1fc7-ac27-45fb-ba88-8eaaa2d0bda1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.716895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1fc7-ac27-45fb-ba88-8eaaa2d0bda1 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.718528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 44/98] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:41.724048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02f7f-4976-4ea4-b7c8-0ca10787288f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.724893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02f7f-4976-4ea4-b7c8-0ca10787288f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.725373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02f7f-4976-4ea4-b7c8-0ca10787288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.746307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-88c02f7f-4976-4ea4-b7c8-0ca10787288f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:41.747511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88c02f7f-4976-4ea4-b7c8-0ca10787288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:41.810873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468c59-3337-403a-9e12-43d409f75dfe None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.811815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468c59-3337-403a-9e12-43d409f75dfe None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.812302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468c59-3337-403a-9e12-43d409f75dfe None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.814010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 45/99] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:41.821225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cc52c-4f3a-4b04-8ba7-ad8e629c6ce4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.821811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cc52c-4f3a-4b04-8ba7-ad8e629c6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.822330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cc52c-4f3a-4b04-8ba7-ad8e629c6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.843685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5f8cc52c-4f3a-4b04-8ba7-ad8e629c6ce4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:41.845229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5f8cc52c-4f3a-4b04-8ba7-ad8e629c6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:41.848571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 55/100] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:41.925759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 46/101] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:41.991504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663cea-ffca-44f2-8b5f-d3dfb359171d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.991807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663cea-ffca-44f2-8b5f-d3dfb359171d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.991989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663cea-ffca-44f2-8b5f-d3dfb359171d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.993454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 56/102] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:41.998735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a735e0f-99a7-44db-8870-f389ff7af281 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.999029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a735e0f-99a7-44db-8870-f389ff7af281 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.999309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a735e0f-99a7-44db-8870-f389ff7af281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.022500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5a735e0f-99a7-44db-8870-f389ff7af281 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:42.023771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5a735e0f-99a7-44db-8870-f389ff7af281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:42.054686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.116453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 47/103] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:42.127399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa349-7d8c-4995-b62b-93f955218ef0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.127685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa349-7d8c-4995-b62b-93f955218ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.127967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa349-7d8c-4995-b62b-93f955218ef0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.129317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 57/104] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:42.135085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.135382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.135664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.158804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:42.160008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:42.243428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 48/105] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:42.318707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffa349-7d8c-4995-b62b-93f955218ef0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.322108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.394730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.439205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffa349-7d8c-4995-b62b-93f955218ef0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.498786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.509858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341a012-ecc3-4d6f-a356-24360b4bbbff None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.545245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.546814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.547460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.548402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.555030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.558682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.559184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.559661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.570881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:42.577959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:42.578799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:42.579597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 58/106] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:42.580204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:42.583047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:42.584314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:42.585156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 49/107] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:42.586538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.731797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6455f-7140-4d30-9132-3eefc4cd1f2a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.737913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d111bfd-a720-4e8b-aa3f-1f34de68640b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.753361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.768962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.769650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.769952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.770481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.780756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.781630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.781876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:42.782000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.782198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.782872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:42.783170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.784541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:42.787911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:42.788740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:42.789495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:42.790926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 59/108] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:42.791931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.794081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 50/109] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.794778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.813325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.911332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baafcc3-c68b-41fe-9615-61a70cdc488c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.937225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262552-d83d-41de-a029-98722a68d29d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.977196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.977816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.978128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.978405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.979081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:42.979442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.980842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.986681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.987389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.987675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.987950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.989115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.990399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 60/110] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.990995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.991230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.992678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 51/111] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.993559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.036460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.080998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.094384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19b2c8-236e-4615-95a7-18cbe9997a5d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.100500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c4080-56e4-4c8c-9441-1e64928b43f8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.133264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.134290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.134679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.134961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.135632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:43.135941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.136962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.137334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.137595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.137877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.138183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] PATH_INFO: `/v3/users/28e103ba42b84fc59fc77291b9cebf5a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.146131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 61/112] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.151948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.152842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] RBAC: Authorizing `identity:get_user(user_id=28e103ba42b84fc59fc77291b9cebf5a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.154383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.156240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 52/113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/users/28e103ba42b84fc59fc77291b9cebf5a => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.156826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.267909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b185ec-79d7-4306-a7ba-b792a0e66b6f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.272365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.275024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9801567-ad6e-4bf3-a17a-8c4da90ffc0e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.307802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.308402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.308628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.308905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.309564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.311353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.320671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.321313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.321594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.321867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.323029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.324477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85605-0b1a-4027-b701-80141e3de7bf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.326241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 53/114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.327236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd495-bc45-4178-baad-cefb695bfc30 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.327521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd495-bc45-4178-baad-cefb695bfc30 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.327797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198fd495-bc45-4178-baad-cefb695bfc30 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.328991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 54/115] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:43.333588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd495-bc45-4178-baad-cefb695bfc30 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.342880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.408488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 62/116] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:43 2022] POST /identity/v3/projects => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:43.419049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.442318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198fd495-bc45-4178-baad-cefb695bfc30 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.482547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3697d-219f-4578-a466-565274255490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.483909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3697d-219f-4578-a466-565274255490 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.484397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3697d-219f-4578-a466-565274255490 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.484925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3697d-219f-4578-a466-565274255490 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.486435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3697d-219f-4578-a466-565274255490 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.488229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3697d-219f-4578-a466-565274255490 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.491213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 55/117] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.492346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3697d-219f-4578-a466-565274255490 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.577650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0090b-9a6b-46b8-8317-6795be3e9bcb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.579050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.606294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3697d-219f-4578-a466-565274255490 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.618734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.619355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.619637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.619913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.644768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.645320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.646595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.647026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.647306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.648460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.649964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eba93-836c-4311-b444-3dc6a6e10c04 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.651623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 56/118] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.652767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e792-6874-4690-9099-667328262966 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.653053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e792-6874-4690-9099-667328262966 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.653332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e792-6874-4690-9099-667328262966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.671829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2f29e792-6874-4690-9099-667328262966 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:43.673047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2f29e792-6874-4690-9099-667328262966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:43.702832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.704718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2116c-6f35-4a8d-a1fd-a7cbee9adb05 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.745528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:43.752285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29e792-6874-4690-9099-667328262966 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.824284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 63/120] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:43.826443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5bfb-8940-43cf-8fea-95a7cbd9d49b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.826928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5bfb-8940-43cf-8fea-95a7cbd9d49b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.827564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5bfb-8940-43cf-8fea-95a7cbd9d49b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.833117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 64/121] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:43.833117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5bfb-8940-43cf-8fea-95a7cbd9d49b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.852188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.878167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29e792-6874-4690-9099-667328262966 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.895427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.916973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.918249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.918635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.919064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.920672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.922892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.925657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 58/122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.926841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.950807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5bfb-8940-43cf-8fea-95a7cbd9d49b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.003807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.004858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.005372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.006121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/users/04db7b67b37f41558e8d4c57ad2b3f70/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.009238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, user_id=04db7b67b37f41558e8d4c57ad2b3f70, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.012098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cc8e-94ca-4b39-ac81-2ab94e8cc16a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.043862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa386d9-6553-4eff-923c-c2bb4edd96e2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.075947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 65/123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:43 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/users/04db7b67b37f41558e8d4c57ad2b3f70/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:44.087894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.088133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.088377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.090139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.090787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.091065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.091420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.092688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.094219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.101510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 59/124] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:44.101510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.118826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:44.120064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:44.120282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.198363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:44.199397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.251450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214366-b3e7-429e-8b19-1dbd521e7dfe None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.257294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.288171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.289177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.289662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.290165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.292326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, user_id=baba34fbf9cc4c40bf5ef26c24eba641, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.294022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.317790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a232b-5e72-4998-9a41-129061f259e0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.351237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.351788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.352071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.352347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.363101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:44.368462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:44.369312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 67/126] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:44.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.390477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 60/127] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:44 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:44.394458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.480551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e1792-1275-46c1-911b-84bc3722261c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.489545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.539461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.540088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.540372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.540648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.541528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=28e103ba42b84fc59fc77291b9cebf5a) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:44.541850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.543386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.550244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 68/128] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/role_assignments?user.id=28e103ba42b84fc59fc77291b9cebf5a&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=1f0dbee369144341a1583bb85b833251 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:44.551432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.551990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.624899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18cd88-d12e-4d75-93a9-68125072991a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.665375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.666880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.666880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.666880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.667236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:44.667551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.669396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.675368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8f44-fd47-431a-ad99-38e3fcef2aa8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.681577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 61/129] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:44.687188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.721496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.722557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.722982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.723422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.735832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:44.742123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:44.743195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:44.744114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:44.746183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 69/130] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:44.759044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.818830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.873591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750629-d02f-407b-8c6f-206bd4c2db9f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.921724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.932400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4125c9-0f76-4d62-8f2d-96be097ce07d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.939671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.940328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.940609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.940890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.946683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.948179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.950013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 62/131] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:44.955866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.975045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.975666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.975948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.976225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.976909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:44.977210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.978702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.997215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 70/132] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.010636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.134330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db5a2-3eb8-4bb8-ba76-5db96e2da691 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.170327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.188480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3e96-7d45-4949-8cd3-7915bd7864e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.208088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d924-01e0-4b32-8192-494665273211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.208734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d924-01e0-4b32-8192-494665273211 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.209049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d924-01e0-4b32-8192-494665273211 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.209394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d924-01e0-4b32-8192-494665273211 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.214727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d924-01e0-4b32-8192-494665273211 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.216213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d924-01e0-4b32-8192-494665273211 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.218068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 63/133] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.223767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d924-01e0-4b32-8192-494665273211 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.237887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.238562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.238850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.239135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.240865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.242404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.250467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 71/134] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:45.255975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.397855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.414572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c82f-61e2-43b4-9ebd-a2c1f08c813f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.456614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d924-01e0-4b32-8192-494665273211 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.482471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.483794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.484415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.485685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] PATH_INFO: `/v3/projects/1d49adc9f6dd4931a559e1447bb2c383` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.488400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=1d49adc9f6dd4931a559e1447bb2c383)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.491310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.495896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 72/135] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/projects/1d49adc9f6dd4931a559e1447bb2c383 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.502855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.533503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.534586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.535666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.536858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.542830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, user_id=baba34fbf9cc4c40bf5ef26c24eba641, role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.544784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77dc5d-d099-4650-a4a0-5a989ee026ca None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.561827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.620565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 64/136] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:45 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:25:45.662168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409c642-83a9-4023-98a0-e75ecb08c8b8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.711194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.712212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.712699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.713209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] PATH_INFO: `/v3/projects/1d49adc9f6dd4931a559e1447bb2c383/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.716790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d49adc9f6dd4931a559e1447bb2c383, user_id=baba34fbf9cc4c40bf5ef26c24eba641, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.718791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.782593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a0e9-e91d-4771-b981-65a70c5d0430 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.783302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a0e9-e91d-4771-b981-65a70c5d0430 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.783832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a0e9-e91d-4771-b981-65a70c5d0430 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.785981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 65/137] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:45.793621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.794299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.794775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.806980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 73/138] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:45 2022] PUT /identity/v3/projects/1d49adc9f6dd4931a559e1447bb2c383/users/baba34fbf9cc4c40bf5ef26c24eba641/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:45.817668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:45.819691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:45.906185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 66/139] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:46.447580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.560143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.576295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a46dc-12bb-4f48-a2c3-a6892d83bd56 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.622710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.623363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.623652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.623930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.625101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.626586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef9332-9953-4eea-bbdf-1514d44e0f1c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.628170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 74/140] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:46.634337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.723240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.783668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c7b44-dc85-4f81-b44d-8454e818b9e1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.835228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.835849 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.836133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.836410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.837067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.838561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b86e-ff4a-4828-9a02-cd9de5debafa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.950838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 67/141] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:47.106110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14d6d-9992-49a1-84f3-b232b22a8cf2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.106461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14d6d-9992-49a1-84f3-b232b22a8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.106665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f14d6d-9992-49a1-84f3-b232b22a8cf2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.108037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 75/142] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:47.113912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f889-a507-4445-8555-35487d4f00b1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.114234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f889-a507-4445-8555-35487d4f00b1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.114519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68f889-a507-4445-8555-35487d4f00b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.143164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ef68f889-a507-4445-8555-35487d4f00b1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.144385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef68f889-a507-4445-8555-35487d4f00b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.215182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 68/143] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:47.432821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2be49-25e6-4028-9d5d-6436ed89b133 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.433151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2be49-25e6-4028-9d5d-6436ed89b133 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.433365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2be49-25e6-4028-9d5d-6436ed89b133 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.434869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 76/144] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:47.440431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.440739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.441211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.466914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.468105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.501965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9998f2-d2c9-44b1-abb4-b22c6c070595 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.502477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9998f2-d2c9-44b1-abb4-b22c6c070595 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.502552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9998f2-d2c9-44b1-abb4-b22c6c070595 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.503852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 77/145] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:47.511041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.511323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.511604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.530123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.541706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:47.543123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:47.593719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 69/146] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:47.599001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.671623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 78/147] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:47.737719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08005282-d9fb-4d4a-9c21-cbda9c3bf9c6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.774682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.775382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.775666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.775941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.786906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:47.791799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:47.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:47.793391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 70/148] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:47.804019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.902789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.918134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb287-0d52-4006-82cc-b5dc471e9b70 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.955078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.955613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.955892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.956165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.956839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:47.957142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.958649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.967753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 79/149] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:47.973225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.008333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.095382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d256-af02-421f-b8c8-4ef46ed79f02 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.133773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.134485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.134763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.135034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] PATH_INFO: `/v3/users/04db7b67b37f41558e8d4c57ad2b3f70` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.136279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] RBAC: Authorizing `identity:get_user(user_id=04db7b67b37f41558e8d4c57ad2b3f70)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.137799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.139600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 71/150] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/users/04db7b67b37f41558e8d4c57ad2b3f70 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:48.145172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.149860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.342664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.347792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe074e39-88a8-4c68-9467-b36d6718d202 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.385010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9351e-31ff-4bfb-ba63-201c914df1ac None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.393549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.394287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.394730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.395143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.409362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:48.417184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:48.418278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:48.419227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:48.426105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 72/151] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:48.426998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.446912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.447902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.448386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.448873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.467690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.543829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.545310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.559350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415353c-e30d-4e3e-a996-a59492df3a84 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.602344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.603214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.603633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.604068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.625574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d88c4fc9-c16d-4b38-8296-20ddafdae4c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:48.631918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:48.632768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:48.633732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:48.636318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 73/152] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:48.637790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9019-bebe-439d-aea7-38fee8eee54e None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.638314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9019-bebe-439d-aea7-38fee8eee54e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.638837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb9019-bebe-439d-aea7-38fee8eee54e None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.640454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 74/153] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:48.641341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb9019-bebe-439d-aea7-38fee8eee54e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.688168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.707298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 80/154] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:48.708178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.793492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb9019-bebe-439d-aea7-38fee8eee54e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.834899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.867105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.868073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.868551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.869037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.869903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:48.870433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.872014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f6a5-3396-4dcb-b761-12e7599a97fc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.888263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 75/155] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:48.891609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b2bf-3ea6-4137-a4d3-0fdf6ed9d6ef None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.893276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b2bf-3ea6-4137-a4d3-0fdf6ed9d6ef None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.894444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b2bf-3ea6-4137-a4d3-0fdf6ed9d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.929064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6f73b2bf-3ea6-4137-a4d3-0fdf6ed9d6ef None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:48.931263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6f73b2bf-3ea6-4137-a4d3-0fdf6ed9d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:48.936031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77e14a-e51c-4371-8473-3e855bd32c9b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.998154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.999596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.000553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.001383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.002847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:49.004375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.006702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.024727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 81/156] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.026043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.093544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 76/157] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:49.094874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbfec3-90d1-483f-976b-5cd46a6aa165 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.095224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbfec3-90d1-483f-976b-5cd46a6aa165 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.095509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbfec3-90d1-483f-976b-5cd46a6aa165 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.096775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 77/158] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:49.097541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbfec3-90d1-483f-976b-5cd46a6aa165 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.132524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.135820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0813-951d-47eb-a72a-fda63dd74ad4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.147532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.171585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.172542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.173016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.173512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.174909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.176547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.179380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 82/159] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.180368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.328064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675dfa6-3ee3-491e-bcab-5508e042fbf1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.395155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbfec3-90d1-483f-976b-5cd46a6aa165 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.395323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.396241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.396983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.397458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.402737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.405394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a4b8-ea71-4a50-8b23-f0a01272e569 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.407290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 83/160] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.408686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.409169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.409656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.459620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:49.460875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:49.466883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.467517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.467792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.468060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] PATH_INFO: `/v3/users/28e103ba42b84fc59fc77291b9cebf5a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.474801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=28e103ba42b84fc59fc77291b9cebf5a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.481863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.481863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 78/161] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/users/28e103ba42b84fc59fc77291b9cebf5a => generated 289 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.481863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.554650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.612239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 84/162] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:49.613116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.635047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.680912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cd6e-6628-45e4-9ded-40fa1972fbc1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.731952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.732623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.732903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.733180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.742809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=04db7b67b37f41558e8d4c57ad2b3f70) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:49.743411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.744954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.751608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 79/163] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/role_assignments?user.id=04db7b67b37f41558e8d4c57ad2b3f70&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.753386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.924063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c779ba-67ed-4066-81fa-14f53643a2ee None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.977074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9960c67-d627-4b45-9dca-80111edcbb7d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.999624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.000279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.000560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.000832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.045253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.045912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.046213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.046490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.047645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.049135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.055170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 80/164] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.056122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.082323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.102834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.150616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.152252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.279645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dafe60-65db-4417-9182-24d139d50f6f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.320222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.320858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.321137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.321407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.340104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:50.345617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:50.345883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:50.347393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:50.348288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:50.349042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:50.351774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 81/166] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:50.353386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.439804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.451004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.467439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcfc4e-e9df-4e50-afd4-610ffb73e096 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.493387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d776e-31c2-42f2-939f-03c2935737d2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.514695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.515477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.515829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.516175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/users/28e103ba42b84fc59fc77291b9cebf5a/roles/1f0dbee369144341a1583bb85b833251` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.518418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, user_id=28e103ba42b84fc59fc77291b9cebf5a, role_id=1f0dbee369144341a1583bb85b833251)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.519942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.539441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.539441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.539441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.539441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.550796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3a01e361-0adb-4e61-b203-0329c8a9411b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:50.558232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:50.565111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 82/167] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:50.565920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3011c-fb88-4d45-8e43-0ff4a352842a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.566705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3011c-fb88-4d45-8e43-0ff4a352842a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.566705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3011c-fb88-4d45-8e43-0ff4a352842a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.566705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 83/168] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:50.566705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3011c-fb88-4d45-8e43-0ff4a352842a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.592167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 86/169] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:50 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/users/28e103ba42b84fc59fc77291b9cebf5a/roles/1f0dbee369144341a1583bb85b833251 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:50.598245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.751544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3011c-fb88-4d45-8e43-0ff4a352842a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.809859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.813146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62dfd-ba49-40f2-952f-f6f6da87a2b8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.819647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.820354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.820637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.820908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.822096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.823572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b776d40-1b6c-4772-9e26-0477f9bf4c3a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.825883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 84/170] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.827607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.827892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.828168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.853751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:50.855004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:50.856414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.857266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.857753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.859313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.860240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:50.860747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.862371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.866402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.875299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 87/171] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.878794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.945529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 85/172] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:50.946882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.993161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38177-5a45-49db-a3d5-d16a9186cac9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.029739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.030626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.031015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.031392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.032166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:51.032603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.034130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.047812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.048930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.087934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed1ef0-4d37-4d63-a2fb-ccc07b47a774 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.114196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.127227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.138667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.139480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.139904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.140317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.141195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:51.141854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.148318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.156858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 86/174] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.160038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.194710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f599bfe-451b-4a7f-a733-98b3dc1f73ef None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.237967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.239005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.239437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.240034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.241629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.244233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541287d-7ed2-464a-ba82-e2586c60acd3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.246172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 89/175] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.247636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eebd-cb55-45e9-b3d4-4ae9b9fc0cbc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.248068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eebd-cb55-45e9-b3d4-4ae9b9fc0cbc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.248867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eebd-cb55-45e9-b3d4-4ae9b9fc0cbc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.250501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 90/176] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:51.251811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a477-c137-4365-813b-753fdd23c7b6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.252281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a477-c137-4365-813b-753fdd23c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.252755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2a477-c137-4365-813b-753fdd23c7b6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.254370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 91/177] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:51.256891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a477-c137-4365-813b-753fdd23c7b6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.370031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aa3f-ef05-4fdd-b63d-b556018a63ef None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.384714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2a477-c137-4365-813b-753fdd23c7b6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.410245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.411417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.411699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.411975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] PATH_INFO: `/v3/users/baba34fbf9cc4c40bf5ef26c24eba641` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.413180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] RBAC: Authorizing `identity:get_user(user_id=baba34fbf9cc4c40bf5ef26c24eba641)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.414675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda8169-3400-4a9c-bfe7-07738deb2b60 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.416443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 87/178] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/users/baba34fbf9cc4c40bf5ef26c24eba641 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.417478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2ee5-5159-4a17-b6f5-0483f8aeb864 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.417761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2ee5-5159-4a17-b6f5-0483f8aeb864 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.418063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb2ee5-5159-4a17-b6f5-0483f8aeb864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.421276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.430132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.431034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.431484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.431945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.439601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0ffb2ee5-5159-4a17-b6f5-0483f8aeb864 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:51.440777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0ffb2ee5-5159-4a17-b6f5-0483f8aeb864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:51.504331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.511527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.513088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.514884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 88/179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:51.523681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.524633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.525120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.551897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:51.554864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:51.632596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 92/180] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:51.633483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.637832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:51.646101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.676629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.797893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40518762-6829-484d-892b-c07e890b2cd7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.812997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef24cf9-04b2-4f66-b0e1-bb8f7564639d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.835427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.836062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.836341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.836618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.839042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.848477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:51.851745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.852573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.858326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.858326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:51.858740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:51.859554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 93/182] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:51.860333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.932556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.934413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.962724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.965648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5385c3-16dc-46d9-bec6-35b8bdae1df4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.007029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.007753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.008100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.008438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] PATH_INFO: `/v3/projects/1d49adc9f6dd4931a559e1447bb2c383` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.009689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1d49adc9f6dd4931a559e1447bb2c383)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.011244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.013271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 94/183] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/projects/1d49adc9f6dd4931a559e1447bb2c383 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.013833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.049030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 90/184] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:52.050655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.076470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.122457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabd80a-8320-4aee-b166-5dadd5ed28f0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.156898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.157313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992439-0976-497c-aa4d-7648f1b91f89 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.157525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.157807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.158117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.169294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:52.174078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:52.174952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:52.175712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 95/185] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:52.176360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.195224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.197602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.198350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.198624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.205006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.205006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.205006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.205006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.214068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 91/186] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.214068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.289696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35ea-ed2e-4262-9657-357c96308397 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.295152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.312056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544adc6a-9d7e-494e-938e-809a01cd8d74 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.326035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.326889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.327341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.327752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.329016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.330626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.332350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 96/187] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.333112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.348939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.349680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.350553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.350921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.351652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=1d49adc9f6dd4931a559e1447bb2c383, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.351963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.353419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.360551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 92/188] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=1d49adc9f6dd4931a559e1447bb2c383&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.361345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.460302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.484107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217e2c-6ece-45d6-a955-e12bb662d76a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.487983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2359-7115-4c84-97df-709053a486b5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.531353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.531976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.532256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.532528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.533502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.533502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.535197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.538848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.539348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.539762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.540481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.541402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.542895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.545349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 97/189] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.545349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.549685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 93/190] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.550875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.564654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.688860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd759a-b167-4d59-a3c3-99375fa0101f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.689829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21582c-fb5c-46c0-8d82-90a0c636d731 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.726588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.727135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.727414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.727686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.728516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.729128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.729408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.729684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.730363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.731814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.745263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.746857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.748590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 98/191] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.750832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.765268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.850426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e63f6-2c3c-45db-a437-5db7b267608d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.859558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 94/192] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:52.860800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.900148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.900770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.901066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.901329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.902116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=baba34fbf9cc4c40bf5ef26c24eba641) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.902428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.903916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.910948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 99/193] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/role_assignments?user.id=baba34fbf9cc4c40bf5ef26c24eba641&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.911694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.961608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.016829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7da928-723f-4efe-b406-dde79e926a5f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.017236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.047002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21739d4-f941-4d48-88c9-dc5f27bc4f0c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.062881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.063531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.063813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.064089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.065271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.066811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf201-3d1a-4ae0-bd07-96e7e3757852 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.068468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 95/194] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.069731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40ff-7c1c-43a2-9047-ad1f58394fda None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.074125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40ff-7c1c-43a2-9047-ad1f58394fda None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.075169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f40ff-7c1c-43a2-9047-ad1f58394fda None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.077365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 96/195] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:53.078818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f40ff-7c1c-43a2-9047-ad1f58394fda None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.093722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.094026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.095420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.095420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.185281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.186800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fc9f6-be0a-4085-8a22-7bc53f09082c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.224280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f40ff-7c1c-43a2-9047-ad1f58394fda None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.262769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.263377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.263651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.270019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.270019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.285886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.327060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 100/196] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:53.328352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.328642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.329369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.346515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.348002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.354851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:53.356075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:53.429889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 101/197] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:53.436191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.485762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 97/198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:53.486913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.527144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.619035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff195-175d-4127-b33f-ec052542d880 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.626709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8137f1-a19b-44f6-bb8e-6a68161647dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.647773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.661669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.662853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.663146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.663416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.664655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.666167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.668039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 102/199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.673692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.727287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.727927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.728204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.728473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.729603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.731078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.732711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 98/200] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.738815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.807734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b0114-3293-4c44-aec2-7de758b8801b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.852532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.853364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.853911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.854375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.855226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=3583116aeafc48b9bd82f45c2b1e6d9d) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.855539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.856971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.864179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 103/201] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/role_assignments?user.id=3583116aeafc48b9bd82f45c2b1e6d9d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:53.869965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.933797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4fc24-fdcc-4c25-a72c-c4b4cd837334 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.936553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.937074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.011417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.012140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.012425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.012776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.013829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=3583116aeafc48b9bd82f45c2b1e6d9d) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:54.014175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.015635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.025242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 99/202] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/role_assignments?user.id=3583116aeafc48b9bd82f45c2b1e6d9d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:54.078283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405856f5-f54d-4d99-9df8-a360680d53d3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.134969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.135618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.135895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.136168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.160077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:54.166166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:54.167166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:54.167966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 104/203] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:54.173351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.349660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbea93-a75a-4f86-a30f-049ab0a1e50b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.406148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.411322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.425071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 100/204] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.431150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.568377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.578080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f298b-ef53-4af9-a687-10a16af7d2c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.620255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.620894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.621172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.621448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] PATH_INFO: `/v3/users/28e103ba42b84fc59fc77291b9cebf5a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.626614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] RBAC: Authorizing `identity:get_user(user_id=28e103ba42b84fc59fc77291b9cebf5a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.628065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.630095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 105/205] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/users/28e103ba42b84fc59fc77291b9cebf5a => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.636032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.703013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.809273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f4018-8bc9-46a2-8423-df37e783464f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.855531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.856139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.856415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.856680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.938596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.939983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e043ee-47f8-41ad-af45-3e47b7885fde None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.977364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.068252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 101/206] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:55.079039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.103741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5603-3518-4c1f-a35d-c25a5311965c None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.104042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5603-3518-4c1f-a35d-c25a5311965c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.104289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5603-3518-4c1f-a35d-c25a5311965c None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.105646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 102/207] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:55.118101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166b4e1-850f-4a89-8887-57a811f89892 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.118366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166b4e1-850f-4a89-8887-57a811f89892 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.118645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166b4e1-850f-4a89-8887-57a811f89892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.148120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d166b4e1-850f-4a89-8887-57a811f89892 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.149328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d166b4e1-850f-4a89-8887-57a811f89892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.258204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 103/208] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:55.260296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05485-3274-4d9d-bc7c-b253f23ffc17 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:55.281792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37273-609d-4ac8-b849-b5014b7f7b37 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.282135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37273-609d-4ac8-b849-b5014b7f7b37 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.282387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37273-609d-4ac8-b849-b5014b7f7b37 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.283747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 104/209] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:55.298664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.299104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.299385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.325657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.326943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.342169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:55.342813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.343096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.343371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.345960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:55.347420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:55.351233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 106/210] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:55.359593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.414353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.448501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.470627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 105/211] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:55.527489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20911d-0c5d-4a50-9653-bd4af28c6ad8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:55.574151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:55.574753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.575035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.575309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.576040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, scope.project.id=e76740df8ff144189fca524ddccfe878, user.id=28e103ba42b84fc59fc77291b9cebf5a) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:55.576344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:55.577782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:55.587007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 107/212] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/role_assignments?user.id=28e103ba42b84fc59fc77291b9cebf5a&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=1f0dbee369144341a1583bb85b833251 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:55.617659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.756074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55594c3-0d82-43c0-99e3-6d3d47955af9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:55.791825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:55.792378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.792653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.792920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.804071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:55.808841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:55.809722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:55.810683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:55.819572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.925739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.936219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360f03a-1711-4709-bf46-90ffe4575f33 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:55.942616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:55.974898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:55.976220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.976610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.976890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.977564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:55.977868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:55.979637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:55.988591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 108/214] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:55.994786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.001240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.056653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10fd5b-5f38-4610-9417-66a845646d00 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.092840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.093472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.093750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.094053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.095172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.097047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.098930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:56.102704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2674f7-bd36-4e88-8c75-a6bb31a1fbc8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.105074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.140353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.141265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.141701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.142222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] PATH_INFO: `/v3/users/a215fe77350d4f28aa5a3b80f74f7505` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.158491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] RBAC: Authorizing `identity:get_user(user_id=a215fe77350d4f28aa5a3b80f74f7505)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.160264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.167605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:55 2022] GET /identity/v3/users/a215fe77350d4f28aa5a3b80f74f7505 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:56.169081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.202304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.214477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a137d7-2033-4871-b98c-213b0070b5a1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.232348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.251500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.252531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.253009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.253488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.254392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.256042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb5aa8-0501-437d-a6f7-cb9dc827ebd9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.277646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eddc5-9b65-47c9-8e5f-9a7d230f2e85 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.317113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.317639 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.317917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.318214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.356975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 108/217] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:56.358287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b00a7-cd38-4e45-9b7c-7becd551dbe6 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.358583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b00a7-cd38-4e45-9b7c-7becd551dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.359102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b00a7-cd38-4e45-9b7c-7becd551dbe6 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.360797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 109/218] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:56.368417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0b73-1405-4f9f-9b78-14d5b50a1517 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.368746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0b73-1405-4f9f-9b78-14d5b50a1517 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.369026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f0b73-1405-4f9f-9b78-14d5b50a1517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.395472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-598f0b73-1405-4f9f-9b78-14d5b50a1517 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:56.397252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-598f0b73-1405-4f9f-9b78-14d5b50a1517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.399797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.402187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.425171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.489455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 110/219] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:56.495458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de10f-6d0f-4414-9f89-2865faf99a3c None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.496381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de10f-6d0f-4414-9f89-2865faf99a3c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.496837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5de10f-6d0f-4414-9f89-2865faf99a3c None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.499147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 111/220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:56.509919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.510474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.510756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.528894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 110/221] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:56.534199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.535549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:56.538053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.637501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 112/222] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:56.658056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5403e52-0426-4411-8367-857d56e9c7f8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.680804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.706761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.707655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.708123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.708613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.709930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.711579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.713678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:56.719355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.761887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.772991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.851577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a84a3-df71-43eb-9834-d4adf79593d5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.900712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.901247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.901518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.901781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.902914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=a215fe77350d4f28aa5a3b80f74f7505) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:56.903213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.904957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.912236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/role_assignments?user.id=a215fe77350d4f28aa5a3b80f74f7505&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:56.927776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2bef-c69f-497d-b2dd-752de762812d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.968194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.969228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.969782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.970288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.970943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.004592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:57.012859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:57.014215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:57.015294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:57.018981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 112/225] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:57.029911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.096144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.162060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7f8a-1c90-4c19-8f89-fe41b4858aa1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.191163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.206416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.207087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50437064-3a69-4ef3-a17d-77a8ddb5abc9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.207627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.208099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.208561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.209492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:57.210574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.212302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.224548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.230592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.303938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.304597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.304969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.305139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.350635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:57.355927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2257c09-f348-42b1-88cd-88935df9bc84 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:57.356291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:57.357109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:25:57.357889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:57.368079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.370457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.401833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.403142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.403674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.404110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.405622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.407598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.410172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:57.416547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.557048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1c92-e29c-440e-8075-0d83f7dfaed5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.641583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.643206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.644881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.645355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.647060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:57.648214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.649791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.665960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3e3d-d314-46f8-8f3f-f0fd0c29a6c3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.668300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.679537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.730425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.750901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.751551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.751834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.752109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.753895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.756458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.758140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:57.765541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.849059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.864740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa3145-8288-4d7a-97b6-38fecff3fcaf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.932587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.933512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.933997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.934640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.936759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.939069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.941014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.950390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.951087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384417-3f6d-472e-9f99-3bb5a5583f10 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.014246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.016342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.017009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.018299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/3583116aeafc48b9bd82f45c2b1e6d9d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.023243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, user_id=3583116aeafc48b9bd82f45c2b1e6d9d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.025648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.084275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.093906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:57 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/3583116aeafc48b9bd82f45c2b1e6d9d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:25:58.123510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b0e2e-dd38-4530-8307-62f567082c59 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.175682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.176752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.177212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.177708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.179196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.180981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369981ff-bd93-4788-9bff-b320d518395f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.183188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:58.188911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.324466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59dd50-0e34-4cf3-9ebe-31aea5d9878b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.326298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.363745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.364798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.365269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.366536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/3583116aeafc48b9bd82f45c2b1e6d9d/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.368972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, user_id=3583116aeafc48b9bd82f45c2b1e6d9d, role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.370694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb1698-69e9-4e02-b963-16fc8f143b88 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.484096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:58 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/3583116aeafc48b9bd82f45c2b1e6d9d/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:59.043399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a8b8-8922-47d8-97f9-cb931e6bfdc9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.043934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a8b8-8922-47d8-97f9-cb931e6bfdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.044038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a8b8-8922-47d8-97f9-cb931e6bfdc9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.045306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:59.050812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.051131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.051411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.072291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:59.073493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.137930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb0e-0730-4472-9fb8-4e34fa95f041 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.138356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb0e-0730-4472-9fb8-4e34fa95f041 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.138743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fefb0e-0730-4472-9fb8-4e34fa95f041 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.140953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 119/236] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:59.146186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64686004-5806-44a4-bd62-3684402189ff None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.146584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64686004-5806-44a4-bd62-3684402189ff None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.147007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64686004-5806-44a4-bd62-3684402189ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.174062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 118/237] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:59.190568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-64686004-5806-44a4-bd62-3684402189ff None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:59.192199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-64686004-5806-44a4-bd62-3684402189ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.289524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 120/238] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:59.517921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:59.592167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a91-cd78-4c62-b928-3512319334e5 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.592167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a91-cd78-4c62-b928-3512319334e5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.592167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065a91-cd78-4c62-b928-3512319334e5 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.592894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 121/239] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:59.599282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.599571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.599840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.633717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:59.634955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.701320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:59.713174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc24dbe-4036-43bc-b79d-2887b006a38d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:59.743960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 122/240] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:59.750773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:59.765261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:59.766176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.766610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.767032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.778668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:59.790425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:59.795269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:59.796117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:25:59.796897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 119/241] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:59.804295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:59.918147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a299ef8-1a33-46da-8188-0685b562d458 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:59.992811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:59.993449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.993726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.994025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.019696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:00.028157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c0e9-163e-4b66-9fbe-95ad4fefb431 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:00.030646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:00.031519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:00.032281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 123/242] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:00.055244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.090484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.091149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.091430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.091699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.092363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:00.092682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.094067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.108259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 120/243] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.108259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.125361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.173722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.212413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c4801-7f36-4478-9823-fd9fa376e1c0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.247249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3e44-3a00-49b8-9a05-56279ec283f5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.257017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.257908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.258495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.258966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.259848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:00.260359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.261973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.270734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 124/244] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.271942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.291360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.291922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.292501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.292784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.294540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.296551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.300493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 121/245] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.306006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.393353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3038772-bfa4-4288-bd88-957d5afc4706 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.424905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.431455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.435562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.435562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.435562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] PATH_INFO: `/v3/users/153e690ec9c6482385bdd7de1b9f85fe` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.437348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.448991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] RBAC: Authorizing `identity:get_user(user_id=153e690ec9c6482385bdd7de1b9f85fe)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.450778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.452846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 125/246] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/users/153e690ec9c6482385bdd7de1b9f85fe => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.457488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd224-b559-4fad-9608-6ccce768226d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.458720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.511825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.513058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.513489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.513903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] PATH_INFO: `/v3/users/a215fe77350d4f28aa5a3b80f74f7505` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.516559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] RBAC: Authorizing `identity:get_user(user_id=a215fe77350d4f28aa5a3b80f74f7505)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.519663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.526023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 122/247] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/users/a215fe77350d4f28aa5a3b80f74f7505 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.527103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.593159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233693-a18a-4e11-b7c4-e017b1c29c65 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.630779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.632452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.632959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.633441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.634342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.636022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.655906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb563f-1077-48f4-b1f6-433ec870ca11 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.696992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.697603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.697926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.698203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.709503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 126/248] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:00.709503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.725431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.777686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.806274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.807998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1a5b6-d417-4724-b134-a8b5e53ecf73 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.846370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611c9d-cdf5-44db-befa-038806d80829 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.889754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.890423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.890823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.891097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.892272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.893732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d27cd-ecbe-41aa-9057-4d0e3254a905 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.895523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 127/249] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.896779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abc06-124e-47c9-9937-fa0d1dfd2a8d None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.897197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abc06-124e-47c9-9937-fa0d1dfd2a8d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.897930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80abc06-124e-47c9-9937-fa0d1dfd2a8d None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.899279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 128/250] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.900703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51308c-e16a-465c-b30e-93657bff4683 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.900703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51308c-e16a-465c-b30e-93657bff4683 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.901023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51308c-e16a-465c-b30e-93657bff4683 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.903643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 129/251] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.903643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51308c-e16a-465c-b30e-93657bff4683 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.961828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 123/252] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:00.963877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12b11-fd9f-4d61-b584-66f53bfb9e65 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.964160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12b11-fd9f-4d61-b584-66f53bfb9e65 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.964439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12b11-fd9f-4d61-b584-66f53bfb9e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.985288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d7d12b11-fd9f-4d61-b584-66f53bfb9e65 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.986501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d7d12b11-fd9f-4d61-b584-66f53bfb9e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:01.046767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51308c-e16a-465c-b30e-93657bff4683 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.056910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.072248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.088746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 124/253] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:01.089879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.093373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.094077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.094357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.094632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/a215fe77350d4f28aa5a3b80f74f7505/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.094938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.095788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.096775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, user_id=a215fe77350d4f28aa5a3b80f74f7505, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.098297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.117251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:01.118470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:01.169330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 130/254] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:00 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/a215fe77350d4f28aa5a3b80f74f7505/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:01.171173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.245987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:01.357323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74128903-2cec-4d56-8c60-4cff653ec2e0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.370947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.437645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.438333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.438738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.439233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.445877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.448070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.451668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 131/256] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.499160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.576813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334d9f5-5058-4a60-b6a4-3c2bdc6f4150 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.600339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.618415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.651811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.652443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.652724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.652997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.675603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:01.681070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c6b41-de62-4eac-bc2b-25f6b94369b9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:01.685333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:01.686221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:01.687009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:01.690891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 126/257] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:01.703550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.758993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.759990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.760471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.760976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.763166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=153e690ec9c6482385bdd7de1b9f85fe) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:01.764486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.766179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.779282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 132/258] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/role_assignments?user.id=153e690ec9c6482385bdd7de1b9f85fe&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=1f0dbee369144341a1583bb85b833251 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.785557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.926476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc631cf-c2a6-490f-86af-dd9dac331652 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.972790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53367-f21d-420a-9744-c4745710ea3b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.992131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.023447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.024212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.024486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.024820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.037341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.038862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.039332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.039889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.042775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:02.042775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.044676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.050975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:02.056770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:02.057633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:02.058450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 127/259] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:02.067947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.071024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 133/260] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.078248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.156611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.302426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388346-f8c1-467a-b9c5-c986d0c6c117 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.323301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a5d0f-b3f9-49a3-959b-2f9c7474ac92 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.378652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.379656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.380244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.380716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.383374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.385110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.387044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 134/261] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:02.389960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.389960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.389960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.389960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.390283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:02.390283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.392516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.394172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.410210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 128/262] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.416206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.469965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.536506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1813b-3a39-4e10-ab6d-397b4693dde1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.571661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.572592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.573073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.573546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.642384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.644726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.646471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.661975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c867f-e666-47ce-87e6-e57d6054f47d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.709961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.744521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.744521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.744521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.744521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] PATH_INFO: `/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.745122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3583116aeafc48b9bd82f45c2b1e6d9d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.746759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.748240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 129/263] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/users/3583116aeafc48b9bd82f45c2b1e6d9d => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:02.753693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.801343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 135/264] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:02.814580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.956145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d093ef-0487-456e-bd00-d1b824ea97d4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.010908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac274a0c-8ea1-4b48-a7ca-0afb58e033b5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.062223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.063285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.063787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.064284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.067186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.068957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.071360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 136/265] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:03.077390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.078426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.079020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.079302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.079578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.118363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.167024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.193409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c32a-2693-43f1-9a79-cc868ec43b20 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.244277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.245295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.245777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.246313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.247261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=3583116aeafc48b9bd82f45c2b1e6d9d) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:03.248524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.250898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.261354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 137/266] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/role_assignments?user.id=3583116aeafc48b9bd82f45c2b1e6d9d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:03.269606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.271762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec7a2-7ef7-43d8-b010-a8b04478531b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.410562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 130/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:03.419111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.509094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.528462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d240-95a1-4349-83d0-2333761edde1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.529552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d240-95a1-4349-83d0-2333761edde1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.529552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39d240-95a1-4349-83d0-2333761edde1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.530970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 131/268] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:03.536027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eae0a-09f0-4c75-bb31-fc19cc42fa17 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.536580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eae0a-09f0-4c75-bb31-fc19cc42fa17 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.537055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eae0a-09f0-4c75-bb31-fc19cc42fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.554229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aee36-f5b5-4e32-a92d-e9f7e22c1c3e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.567323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-461eae0a-09f0-4c75-bb31-fc19cc42fa17 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:03.569707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-461eae0a-09f0-4c75-bb31-fc19cc42fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:03.621985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.622210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.622463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.622737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.624002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.626577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abadbfc-2a4d-4948-b691-74ad96b49048 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.628576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 138/269] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:03.629916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f71d-9aed-4b2f-9595-ed513277ca1b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.630237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f71d-9aed-4b2f-9595-ed513277ca1b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.630513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f71d-9aed-4b2f-9595-ed513277ca1b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.632559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 139/270] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:03.634828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187f71d-9aed-4b2f-9595-ed513277ca1b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.659149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.673107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 132/271] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:03.674878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.675420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.676004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.703251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:03.705034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:03.773835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187f71d-9aed-4b2f-9595-ed513277ca1b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.793601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 133/272] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:03.817450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.818092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.818374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.818648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.819426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=3583116aeafc48b9bd82f45c2b1e6d9d) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:03.819809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.821330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.827992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 140/273] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/role_assignments?user.id=3583116aeafc48b9bd82f45c2b1e6d9d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.079460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.160009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.165035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.214950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a6368-e934-4c06-9ed0-6aa05cbd3af2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.240418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.257233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.258059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.258440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.258834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.260278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.261645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.267801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 134/274] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.270006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.298218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108a2c9-990e-44c0-a91b-e636a4351401 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.338345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.338898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.339172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.339441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.349847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-500bf543-5d64-41ad-abe7-159217cff938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:04.356511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:04.357373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:04.358253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 141/275] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:04.358897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc91-57a6-4576-ae8f-7368f51d294b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.359311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc91-57a6-4576-ae8f-7368f51d294b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.359816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc91-57a6-4576-ae8f-7368f51d294b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.362033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 142/276] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:04.363358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc0-26c1-45dd-a42a-f114c7577fa9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.363649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc0-26c1-45dd-a42a-f114c7577fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.363925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4dfc0-26c1-45dd-a42a-f114c7577fa9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.365157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 143/277] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:04.365855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4dfc0-26c1-45dd-a42a-f114c7577fa9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.392095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14150ccb-d88a-43e1-9e13-3aed7102e03a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.426096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.426694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.426972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.427245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.427880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.428649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.429384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845810-cfe0-4be5-9b2a-1f33b6bd0f60 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.467038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4dfc0-26c1-45dd-a42a-f114c7577fa9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.500880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.501532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.501803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.502101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.502749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:04.503045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.504426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69f0c9-26fe-4050-ae7e-2f8f6f354994 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.513316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 144/278] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.514519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.514806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.515085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.533475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 135/279] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:04.533475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.533475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.533475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.538762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:04.540051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.564006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:04.565421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.614762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.617974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 145/280] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:04.618827 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.664992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 136/281] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:04.692014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.745149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefac853-4de5-4251-989f-b8556f8f80ac None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.780505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.781136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.781419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.781695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] PATH_INFO: `/v3/users/3b9870b9a11e48d087d5e8da34d6b084` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.795260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] RBAC: Authorizing `identity:get_user(user_id=3b9870b9a11e48d087d5e8da34d6b084)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.796731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.798572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 146/282] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/users/3b9870b9a11e48d087d5e8da34d6b084 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.804853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.900944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.921984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3589a-7a74-4539-b413-d735ff041e61 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.961602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.962297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.962580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.962858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.963598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, user.id=3b9870b9a11e48d087d5e8da34d6b084, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:04.963909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.965347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.972432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 137/283] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/role_assignments?user.id=3b9870b9a11e48d087d5e8da34d6b084&scope.system=all&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.973248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.033144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.050948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea61-3e20-4cf3-b9ee-6d2188e4fc7e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.072162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.098619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.099521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.101167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.101598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.115632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a62e4-831f-4c2d-8f2c-f87b458ef555 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.116929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:05.122264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:05.123407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:05.124396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:05.126744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 147/284] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:05.134329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.154636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.155296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.155583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.155861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.168413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:05.173611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:05.174735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:05.175625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 138/285] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:05.181079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.252888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5e5e-e395-4a21-b3d1-806291dfdf29 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.286345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.291082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.294033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.294139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f4b52-3f7a-4623-ace5-00c183ecb094 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.294216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.294216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.294216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:05.294216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.294963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.310651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 148/286] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:05.317351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.339527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.340186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.340470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.340745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.341421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:05.341724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.344698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.362164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:05.369472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.389774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.510329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb4e3-6443-4124-b032-f1ff82c4407a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.553962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60303b-0a4d-4a7e-b176-7864c00a0ed8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.576058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.576704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.576982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.577251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] PATH_INFO: `/v3/users/153e690ec9c6482385bdd7de1b9f85fe` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.578541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] RBAC: Authorizing `identity:get_user(user_id=153e690ec9c6482385bdd7de1b9f85fe)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.579993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.581749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 149/288] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/users/153e690ec9c6482385bdd7de1b9f85fe => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:05.589563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.621321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.622200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.622783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.623193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] PATH_INFO: `/v3/users/a215fe77350d4f28aa5a3b80f74f7505` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.627990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] RBAC: Authorizing `identity:get_user(user_id=a215fe77350d4f28aa5a3b80f74f7505)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.629453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.631253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/users/a215fe77350d4f28aa5a3b80f74f7505 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:05.639330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.701478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.805318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448dbba-8d54-4086-8b71-39b3dae0e01b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.808783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b25d-bb03-4d27-9092-ceed179ac258 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.822281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.875891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.876522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.876803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.877079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.878206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.878806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.879081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.879354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.880456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.882453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.893747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 150/290] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:05.894621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.020265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.021754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.100306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75b7c9-ac22-4aec-b720-d0b9f056f19e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.100956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.140100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.140764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.141046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.141650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/153e690ec9c6482385bdd7de1b9f85fe/roles/1f0dbee369144341a1583bb85b833251` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.143652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, user_id=153e690ec9c6482385bdd7de1b9f85fe, role_id=1f0dbee369144341a1583bb85b833251)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.145572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.205401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 141/291] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:06.211525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.222213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:05 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/users/153e690ec9c6482385bdd7de1b9f85fe/roles/1f0dbee369144341a1583bb85b833251 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:06.370454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7b84-d601-4289-8bdd-7a08f98ee758 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.412631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.425498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.426177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.426464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.426745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.427919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.429901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca29a35-39a9-4811-b083-15a593adad8c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.435026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:06.439540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.485090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.563139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076f10-79f6-4722-891f-16ff78cb804c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.609772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.610394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.610667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.610995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.611723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=a215fe77350d4f28aa5a3b80f74f7505) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:06.612023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.613460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030812-1d04-4a11-b63b-6d68da44cfcc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.620619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 152/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/role_assignments?user.id=a215fe77350d4f28aa5a3b80f74f7505&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:06.987801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b611-3487-4c4a-b0c6-61b987e91a8b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.988282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b611-3487-4c4a-b0c6-61b987e91a8b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.988282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b611-3487-4c4a-b0c6-61b987e91a8b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.989843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 143/295] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:06.995429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fba4-98c2-41cd-8fe2-f1daea6298d6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.995713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fba4-98c2-41cd-8fe2-f1daea6298d6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.995989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61fba4-98c2-41cd-8fe2-f1daea6298d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.017192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ee61fba4-98c2-41cd-8fe2-f1daea6298d6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.018414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ee61fba4-98c2-41cd-8fe2-f1daea6298d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.108048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 153/296] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.223121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261a4b-9ffd-4881-8d6b-fdcea17c5efa None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.223439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261a4b-9ffd-4881-8d6b-fdcea17c5efa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.223703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261a4b-9ffd-4881-8d6b-fdcea17c5efa None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.225287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 144/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.231591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356648-4f84-4f3a-acad-e7dbba5cf39b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.231876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356648-4f84-4f3a-acad-e7dbba5cf39b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.232148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356648-4f84-4f3a-acad-e7dbba5cf39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.253801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ef356648-4f84-4f3a-acad-e7dbba5cf39b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.255340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef356648-4f84-4f3a-acad-e7dbba5cf39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.280162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.328695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.341034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb886-1542-4e85-8fbf-c8136745c18b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.341314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb886-1542-4e85-8fbf-c8136745c18b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.341585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cb886-1542-4e85-8fbf-c8136745c18b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.343291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 145/299] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.348363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.348873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.349333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.368092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.369529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.430475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cb886-1542-4e85-8fbf-c8136745c18b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.440039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 155/300] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.546634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cb886-1542-4e85-8fbf-c8136745c18b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.588083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.588705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.588980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.589244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.599731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:07.605169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:07.606049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:07.606822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 146/301] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:07.612539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.645164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.704963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.712248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.721749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e15d6-b642-4a99-b1ed-70f51554710d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.760375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.760866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08cd3-8e06-40b6-811c-7a4f40dfa4f8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.760973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.761251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.761519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.762313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:07.762517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.763902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.773883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 156/302] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.774740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.798500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.799059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.799339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.799616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.800710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.802173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.803766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 147/303] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.804525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.891490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22d392-b164-4927-af9b-d005f36530fe None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.910562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0588e-1cf0-4bf5-9338-0f7d0f781f8f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.925571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.926227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.926504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.926775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.936204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.937024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:07.942176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:07.948829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 157/304] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:07.949802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.955262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.955910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.956317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.956600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] PATH_INFO: `/v3/users/0911a711e02844ed94db738c4265de5f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.958845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.971570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] RBAC: Authorizing `identity:get_user(user_id=0911a711e02844ed94db738c4265de5f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.973280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.980951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 148/305] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/users/0911a711e02844ed94db738c4265de5f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.981803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.057301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783ae9-d6d5-47fd-862b-012add0918e8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.088172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cc06f-f4df-4060-8b8a-142542dc6675 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.092891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.093497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.093776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.094081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] PATH_INFO: `/v3/groups` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.094709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.096154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.125917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.126629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.126977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.127315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.128047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:08.128350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.129702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.138507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 149/306] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.139296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.184061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.207884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 158/307] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:08.208713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.259826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147f70-85f7-4d76-a690-ecb95edab174 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.301831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.317131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.317131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.317131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.317131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.317525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, user.id=0911a711e02844ed94db738c4265de5f, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:08.317525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.317525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.323690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 150/308] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/role_assignments?user.id=0911a711e02844ed94db738c4265de5f&scope.system=all&role.id=1f0dbee369144341a1583bb85b833251 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.348630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0437f-fcb2-461d-a955-9289f5bb22ce None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.390628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.391287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.391568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.391843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] PATH_INFO: `/v3/users/3b9870b9a11e48d087d5e8da34d6b084` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.393051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] RBAC: Authorizing `identity:get_user(user_id=3b9870b9a11e48d087d5e8da34d6b084)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.394662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a80d-98eb-401d-aa65-3c5cc2175512 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.396554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 159/309] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/users/3b9870b9a11e48d087d5e8da34d6b084 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.406132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.416438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a069-34b8-4570-a05b-e450a663b543 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.416746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a069-34b8-4570-a05b-e450a663b543 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.417000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736a069-34b8-4570-a05b-e450a663b543 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.419456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 160/310] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:08.425369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.425670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.425922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.488360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:08.489732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:08.547195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597401ab-49e3-439c-9021-a041c9355d52 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.557479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.570619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 161/311] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:08.588618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.589797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.590486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.590963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] PATH_INFO: `/v3/system/users/3b9870b9a11e48d087d5e8da34d6b084/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.592622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b9870b9a11e48d087d5e8da34d6b084, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.594310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.665048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 151/312] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:08 2022] PUT /identity/v3/system/users/3b9870b9a11e48d087d5e8da34d6b084/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:08.851319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.918822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.953874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380cbf8-57ff-42ec-9993-965468f1d367 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.989382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.990033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.990312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.990582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.000901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:09.005725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:09.006615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:09.008355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 162/313] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:09.013450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.118171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c41e8-8b3f-4af0-be37-6cfe95ffdd4e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.153640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.154277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.154555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.154826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.155492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.155791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.157166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.165975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 152/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.171216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.276711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ccf41-fa5a-43b7-8dff-bad56dd4fabe None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.302715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.311904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.312541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.312821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.313095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] PATH_INFO: `/v3/users/153e690ec9c6482385bdd7de1b9f85fe` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.314254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=153e690ec9c6482385bdd7de1b9f85fe)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.321962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.321962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 163/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/users/153e690ec9c6482385bdd7de1b9f85fe => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.323892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.360932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.438398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaadbb-41ec-44cc-b784-886ed68e5ba2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.478398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.479053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.479337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.479613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.550289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.551759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.586512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.655301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 153/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:09.660568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.764464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec835f-60fa-4848-8618-3376866fecc9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.799047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.799685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.799962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.800233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.801345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.802827 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ee568-d724-47a5-b07e-9734cc34f535 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.805240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 164/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.810865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.918392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164a2f-4de4-4ccc-8c6f-6f3fe59d9d11 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.954061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.955004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.955490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.955964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.956909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, scope.project.id=cc9dab2586954d1097f046a8337e6f06, user.id=153e690ec9c6482385bdd7de1b9f85fe) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.957420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.959175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a81a7-3dbd-44a9-8071-b86ed950b3cf None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.965717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 154/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/role_assignments?user.id=153e690ec9c6482385bdd7de1b9f85fe&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=1f0dbee369144341a1583bb85b833251 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.973965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.231322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4318-efc3-401e-acd9-27f0ca9a6225 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.231649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4318-efc3-401e-acd9-27f0ca9a6225 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.231839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4318-efc3-401e-acd9-27f0ca9a6225 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.233157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 165/319] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:10.238520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5646-1c2f-4c57-89e1-9aa0336cfa1b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.238955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5646-1c2f-4c57-89e1-9aa0336cfa1b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.239127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc5646-1c2f-4c57-89e1-9aa0336cfa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.258189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fcdc5646-1c2f-4c57-89e1-9aa0336cfa1b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:10.259365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fcdc5646-1c2f-4c57-89e1-9aa0336cfa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:10.327600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 155/320] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:10.334905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516b06-251c-44b1-8639-f8133fe4e978 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.335718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516b06-251c-44b1-8639-f8133fe4e978 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.335980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6516b06-251c-44b1-8639-f8133fe4e978 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.337462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 166/321] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:10.342341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.342633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.342907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.361893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:10.363100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:10.430722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 156/322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:10.594186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6516b06-251c-44b1-8639-f8133fe4e978 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.656974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.701325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.704945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6516b06-251c-44b1-8639-f8133fe4e978 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.740087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.740713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.740995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.741292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.742954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.744386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07822aa0-00ee-4d12-b3f1-d414093e957c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.745959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 167/323] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:10.747136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3d00-a6cf-4e8b-bc08-4bc44e2317f0 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.747414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3d00-a6cf-4e8b-bc08-4bc44e2317f0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.747682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e3d00-a6cf-4e8b-bc08-4bc44e2317f0 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.748997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 168/324] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:10.751376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e3d00-a6cf-4e8b-bc08-4bc44e2317f0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.762177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.804363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe9f9-5d61-409d-95b0-d6bce24a0bcc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.840624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.841249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.841529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.841801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.852309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4197f128-f55c-48cd-9a9e-572a7d816ef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:10.857078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:10.858163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:10.859087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 157/325] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:10.860151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.860151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.860291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.863129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e3d00-a6cf-4e8b-bc08-4bc44e2317f0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.877480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:10.878695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:10.891149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.897002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.901344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.901344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.901344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] PATH_INFO: `/v3/groups` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.901344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.901344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.943799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 158/326] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:10.944739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.992595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.002740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 169/327] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:10 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:11.047235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644be9b3-5379-40fb-8a31-92fc00f8277f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.090220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.090848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.091129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.091403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.092088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:11.092449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.093858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.108262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 159/328] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.110138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.222110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184c60-623f-4338-982e-5c9fc8c0bb08 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.233106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.266734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.267713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.268168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.268607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] PATH_INFO: `/v3/users/0911a711e02844ed94db738c4265de5f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.270024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] RBAC: Authorizing `identity:get_user(user_id=0911a711e02844ed94db738c4265de5f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.271858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.275164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 170/329] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/users/0911a711e02844ed94db738c4265de5f => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.283476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.353073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.375107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bebd9-d7e1-4b67-a18e-a8fa8c46b5d7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.380116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.410398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e603cd4-bb80-400a-a96f-97577743e504 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.422075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.422781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.423067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.423364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.441411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:11.447781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:11.448840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:11.449820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:11.452888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 160/330] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:11.458045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.463226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.464291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.464291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.464291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] PATH_INFO: `/v3/system/users/0911a711e02844ed94db738c4265de5f/roles/1f0dbee369144341a1583bb85b833251` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.465890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0911a711e02844ed94db738c4265de5f, role_id=1f0dbee369144341a1583bb85b833251)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.467506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.535125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 171/331] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:11 2022] PUT /identity/v3/system/users/0911a711e02844ed94db738c4265de5f/roles/1f0dbee369144341a1583bb85b833251 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:11.585445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89f958-a54d-404f-8451-bc34f3c137d6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.633452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.634310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.634587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.634857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.635607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:11.635913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.637335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.647594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 161/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.653000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.793839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d3fba-c2e9-441c-bcfd-95dc268da3ec None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.818440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.832813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.833450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.833730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.834358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] PATH_INFO: `/v3/users/3b9870b9a11e48d087d5e8da34d6b084` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.836228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] RBAC: Authorizing `identity:get_user(user_id=3b9870b9a11e48d087d5e8da34d6b084)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.837770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0337eb2-f29b-4cab-8b32-e9154d44c6bb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.839417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 172/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/users/3b9870b9a11e48d087d5e8da34d6b084 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.845409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.887800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.963239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e6df8-75f6-458d-8f6a-f13127e5a9b6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.003867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.004769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.005218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.005681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.008159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] RBAC: Adding query filter params (role.id=a173a3f73a994a4ba4a5df3459bfb165, user.id=3b9870b9a11e48d087d5e8da34d6b084, scope.system=all) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:12.008945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.010589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615422-54a4-4f05-86c5-4d2b396e1839 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.022894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 162/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/role_assignments?user.id=3b9870b9a11e48d087d5e8da34d6b084&scope.system=all&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:13.384713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c507-65eb-4339-81b7-405229420e83 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.385236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c507-65eb-4339-81b7-405229420e83 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.385236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437c507-65eb-4339-81b7-405229420e83 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.386915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 173/335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:13.395291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fc59-e047-41c4-b7be-1ca6359e7ed6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.395708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fc59-e047-41c4-b7be-1ca6359e7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.395900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fc59-e047-41c4-b7be-1ca6359e7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.419247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-efa4fc59-e047-41c4-b7be-1ca6359e7ed6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:13.420435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-efa4fc59-e047-41c4-b7be-1ca6359e7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.519954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 163/336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:13.589536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988d6d7-1afb-4ea2-8b42-5ab9e0d3bd25 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.589826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988d6d7-1afb-4ea2-8b42-5ab9e0d3bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.590121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988d6d7-1afb-4ea2-8b42-5ab9e0d3bd25 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.591466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 174/337] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:13.596941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.597229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.597499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.626924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:13.628119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.643168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:13.724502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 164/338] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:13.953888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988d6d7-1afb-4ea2-8b42-5ab9e0d3bd25 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.078906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988d6d7-1afb-4ea2-8b42-5ab9e0d3bd25 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.115165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.127373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.128009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.128283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.128557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.150867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:14.155810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:14.156686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:14.157465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:14.158572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 175/339] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:14.162909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.255717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edba17f-19fa-4dee-9384-ddabe15c3980 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.280863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.311129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.312155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.312638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.313252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.337571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:14.348268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:14.349158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:14.349929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:14.352358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 165/340] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:14.363139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.380921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd71f8-9ccb-4e71-9a10-2ffdecc9c100 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.398976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.447806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.448489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.448774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.449050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.449714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:14.450035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.459049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95865641-4e7d-4edf-b8d3-2a6a31a5f4c9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.469620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 176/341] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.470963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26317299-b439-4bdd-89b0-8224f5dbe735 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.471249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26317299-b439-4bdd-89b0-8224f5dbe735 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.471521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26317299-b439-4bdd-89b0-8224f5dbe735 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.479755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 177/342] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:14.481733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26317299-b439-4bdd-89b0-8224f5dbe735 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.561565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef161-801c-420d-8f7d-4dd1bdf60122 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.600353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.600993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.601269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.601537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.602234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:14.602538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.605123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dea87-69d7-429e-853e-d8ebc924823c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.615222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 166/343] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:14.617080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.617417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.617695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.636300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:14.637509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:14.704622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26317299-b439-4bdd-89b0-8224f5dbe735 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.714949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 167/344] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:14.715555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.723499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.730263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.781036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.781650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.781948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.782237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.821538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc274b-7a36-42f9-aace-e36aa0a1efdc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.857786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.858436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.858703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.858976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.924257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.925746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce599a-1297-49a3-9b42-52aba33a4b2d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.933650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.935171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856eedd-3c94-4301-acb7-bde9ac243abc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.950329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.049893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 168/345] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:15.051417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef3bf-2ecf-4c77-9ca0-48116d01d792 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.051776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef3bf-2ecf-4c77-9ca0-48116d01d792 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.052121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef3bf-2ecf-4c77-9ca0-48116d01d792 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.053724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 169/346] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:15.055893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef3bf-2ecf-4c77-9ca0-48116d01d792 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.082277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 178/347] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:15.083524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.083888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.084165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.104384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:15.105574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:15.114138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.197823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 179/348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:15.198910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.245923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef3bf-2ecf-4c77-9ca0-48116d01d792 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.247716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.319801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.320441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.320719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.320991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.322327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.323769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.330129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 170/349] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.331033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.363029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf219942-9078-4e1f-b365-d747a3b27e16 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.402701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.403334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.403611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.403883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.405058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.406556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.408188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 180/350] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.408947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.421978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.517262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805f79-17dc-4074-b0c1-2e4c52861aad None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.528327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c21f4-8bcb-459c-a061-efc491a22e2f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.552435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.553060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.553342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.553611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.560360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.561818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.563808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 181/351] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.565076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.571839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.572754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.573032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.574283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.590784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:15.597842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:15.598755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.599536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:15.600133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 171/352] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:15.601667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.638428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.661748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.712347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4bcb-f155-4ca1-bf2c-2b1d75193f6f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.740277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037b3c9-138e-4922-a829-f80ae1565266 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.748878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.749747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.750205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.750617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.751878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.753477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.755543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 182/353] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.756515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.781369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.782110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.782392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.782716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.799268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:15.805093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:15.806136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:15.806958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 172/354] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:15.807656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.891791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadc9e9-fe2a-4002-a9fa-3b3719f06ae3 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.926899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.941983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436b22-eb76-4a78-bdca-2557505421bb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.944535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.946050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.946522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.946799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.947546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=e76740df8ff144189fca524ddccfe878) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:15.947856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.949310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.958506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 183/355] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.959846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.971739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.994284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.995339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.995740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.996142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.996954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:15.997334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.998854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3c677-296e-4042-89b2-a77d7bc43e30 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.009817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 173/356] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.015256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca08ea-b903-4b11-aee3-b6e665036bd7 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.015613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca08ea-b903-4b11-aee3-b6e665036bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.015967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca08ea-b903-4b11-aee3-b6e665036bd7 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.021667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 174/357] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:16.021667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca08ea-b903-4b11-aee3-b6e665036bd7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.109720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7836-9692-4904-bcfa-597792bfd262 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.154080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.155003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.155438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.155707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.156449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=e76740df8ff144189fca524ddccfe878) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.156762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.158132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca08ea-b903-4b11-aee3-b6e665036bd7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.158250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.164013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 184/358] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.164639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.228516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.229190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.229470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.229742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.230456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.230761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.232176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f874191-330f-42cb-bb9f-28b8f7ab6675 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.248425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 175/359] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.250988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15dac-a592-4938-9b18-252bad28bace None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.251914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15dac-a592-4938-9b18-252bad28bace None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.252875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15dac-a592-4938-9b18-252bad28bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.274380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.282780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c6a15dac-a592-4938-9b18-252bad28bace None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:16.283989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6a15dac-a592-4938-9b18-252bad28bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.302960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.326748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfddd9-3918-49b6-9ab3-684e300a1049 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.367859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.368853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.369131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.369997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.399528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 176/360] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:16.399528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a59-7749-4e82-a47f-b8c9789e7ab1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.399528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a59-7749-4e82-a47f-b8c9789e7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.399528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012a59-7749-4e82-a47f-b8c9789e7ab1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.399528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 177/361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:16.400318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012a59-7749-4e82-a47f-b8c9789e7ab1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.518530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.566829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012a59-7749-4e82-a47f-b8c9789e7ab1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.635803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.636438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.636713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.636980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] PATH_INFO: `/v3/users/0911a711e02844ed94db738c4265de5f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.639187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] RBAC: Authorizing `identity:get_user(user_id=0911a711e02844ed94db738c4265de5f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.640606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851012ab-2c12-4004-af3f-9d567f8e064a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.642221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 178/362] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/users/0911a711e02844ed94db738c4265de5f => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.643333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.643610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.643878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.660110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.684445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:16.685640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.702067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.722516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 185/363] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:16.723378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.802292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 179/364] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:16.803197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.847732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eff94-521d-4a3f-8538-bd6d09be8151 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.883492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.884180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.884521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.884729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.885448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] RBAC: Adding query filter params (role.id=1f0dbee369144341a1583bb85b833251, user.id=0911a711e02844ed94db738c4265de5f, scope.system=all) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.885753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.887227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.899942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 186/365] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/role_assignments?user.id=0911a711e02844ed94db738c4265de5f&scope.system=all&role.id=1f0dbee369144341a1583bb85b833251 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.900751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.934165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6f091-fd74-4700-a2e9-02911513b0b2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.950360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.013243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.013898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.015476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.015754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.017735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.019195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.030403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 180/366] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.031379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.058432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.071052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901137-2ae9-4384-9946-5e8dd2275c7c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.117962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.118700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.118978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.119247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.130888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.136976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.137882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:17.138705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:17.139321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 187/367] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.145420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.206907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e764e-3006-42fb-90df-125062f1a194 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.250380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.260110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b391f-613e-45be-b1f9-bf14d6878044 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.286663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.288246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.289831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.290348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.291855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.293622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.295789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 181/368] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.301257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.301870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.302111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.302212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.302444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.303111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.303408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.304941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.314313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 188/369] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:17.320404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.416697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.443691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d615638-19dc-40c7-ab1b-27966457336e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.452880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7f960-db1c-49a6-8489-9627e2c3725a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.485991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.486604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.486877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.487212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.487980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=cc9dab2586954d1097f046a8337e6f06) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.488286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.489714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.496615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 182/370] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:17.497547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.498010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.498627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.498909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.499185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.525445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.612652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.614326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.695361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826364d0-e36f-47c1-8864-82d26aba125a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.762103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 189/371] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:17.766178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.766824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.767275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.768174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.779813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.797778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.802629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.803518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.804965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:17.809730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 183/372] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.815566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.819986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.860949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.957734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdfde0-caff-4eae-9014-1232604b3bff None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.994928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62eba9a-67ed-4fb5-8cc4-0a3ad47922e2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.035480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.036101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.036380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.036656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.037326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.037632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.038058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.038963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.039065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.039521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.040002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.041321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.042968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.045106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 190/373] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.050216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.054043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 184/374] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.055278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.124564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.162527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cf32b-18ce-49d4-8176-053ac154b4f9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.200961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.201576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.201991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.202278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.228252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a791b7-43a5-4ad0-8359-87d74901d3b8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.253212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.278431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.279902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f5bc6-5073-4d43-97ca-7fe2426d1897 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.284360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.285003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.285278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.285546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.290401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.292097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.293920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.300067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.350350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.402081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 185/376] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:18.403492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6593cb-692c-4de7-909e-d79e547661ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.403782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6593cb-692c-4de7-909e-d79e547661ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.404057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6593cb-692c-4de7-909e-d79e547661ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.405833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 186/377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:18.407532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6593cb-692c-4de7-909e-d79e547661ef None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.443646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856efe7-6a57-48c1-8015-a491afdcb8e9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.487075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.487599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.487932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.488204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.489076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=cc9dab2586954d1097f046a8337e6f06) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.489389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.490855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d8c3-01ce-41a0-a651-4b78df8a24ad None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.498064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 192/378] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.504943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba777-95e7-408c-a80a-4712e10b0e50 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.505320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba777-95e7-408c-a80a-4712e10b0e50 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.505597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba777-95e7-408c-a80a-4712e10b0e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.517080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6593cb-692c-4de7-909e-d79e547661ef None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.539525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-88bba777-95e7-408c-a80a-4712e10b0e50 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:18.540759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-88bba777-95e7-408c-a80a-4712e10b0e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:18.561629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.562342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.562622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.562896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] PATH_INFO: `/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.564926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] RBAC: Authorizing `identity:get_project(project_id=bcc2c09443be4848acb9a6d8fb8bb990)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.566838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.568578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 187/379] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.576912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.628066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.641719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.673562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 193/380] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:18.711377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bdc07-6baa-42a3-bbe1-68e2d4741598 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.759718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.760294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.760575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.760855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] PATH_INFO: `/v3/groups/15151af876b84f1db915adc138d65dec` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.764243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6699-840e-4a2f-a56e-f4db0d7f7b20 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.764529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6699-840e-4a2f-a56e-f4db0d7f7b20 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.764804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6699-840e-4a2f-a56e-f4db0d7f7b20 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.766304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 194/381] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:18.770677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] RBAC: Authorizing `identity:get_group(group_id=15151af876b84f1db915adc138d65dec)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.771915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.772139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.772591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.773140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.774180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 188/382] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/groups/15151af876b84f1db915adc138d65dec => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.779841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.805032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:18.806607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:18.922300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.933605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7444-b05a-4707-890d-2fc68643a57f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.934847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 195/383] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:18.995583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.996207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.996482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.996751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.997482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] RBAC: Adding query filter params (group.id=15151af876b84f1db915adc138d65dec, role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=bcc2c09443be4848acb9a6d8fb8bb990) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.997785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.999263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.009448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 189/384] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/role_assignments?group.id=15151af876b84f1db915adc138d65dec&scope.project.id=bcc2c09443be4848acb9a6d8fb8bb990&role.id=15131bc73ffe4de98028e781cae256f3 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:19.030388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.165199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4851f3-0af1-4a61-84dc-98e91536d83e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.177114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.206096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.206749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.207029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.207306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.218530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:19.223483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:19.224361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:19.225145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:19.227368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 196/385] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:19.230537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.270148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.357553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c71bd-4f59-40ec-8e67-6019a2bc3095 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.402177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.403167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.403645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.405610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.406531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.407037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.408713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.414301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da981ef2-b777-4785-9bd4-5510a0f384a4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.421111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.426215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.454302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.459898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.460659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.461011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.461357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.475587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:19.482623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:19.483553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:19.484347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 197/387] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:19.491727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.529242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.547129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3500-a680-4700-a7cd-bfd7978fde38 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.585167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.586711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.587171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.587622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.588953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.590699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.592814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 191/388] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.597796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.608080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2616855-90c9-42ce-886f-b9ea0cf21e68 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.686269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.686998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.687353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.687703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.688471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.688847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.690507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.705911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.707811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 198/389] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:19.713087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.717838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dae68-0a39-44a4-abc5-d214754c5fbe None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.778009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.778665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.778943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.779268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.782068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.783783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.785597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 192/390] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.790928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.838033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.847907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86195f-ea96-4585-adc0-ce442c1f2057 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.886480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.887649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.888133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.888620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.890056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.892169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.898194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 199/391] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.900495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.993268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b90c-4bb7-4583-9386-0d5b6b741aed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.021363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8f63-ff71-41cf-82c1-99ec310f01d8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.059731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.060742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.061224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.061696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.063256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.064947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.072260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 200/392] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:20.073680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.103472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.104197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.104476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.104749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.110387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, group_id=7aefb7c9204741de9a3f6405ec2d3b5d, role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.110576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.111882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1925f-fd7f-425e-9f06-34603b0b5f12 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.185342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0f9c-3cd4-4363-8761-0800f9bf7a95 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.206420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 193/393] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:19 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:20.226097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.227721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.228205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.228750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.231200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=e76740df8ff144189fca524ddccfe878, group_id=7aefb7c9204741de9a3f6405ec2d3b5d, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.232936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d04c-6da2-40c8-ba04-bdc896344b6c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.292477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 201/394] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:20 2022] PUT /identity/v3/projects/e76740df8ff144189fca524ddccfe878/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:20.356348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3853-8fe1-4f85-b329-d9c6400ddd56 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.356696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3853-8fe1-4f85-b329-d9c6400ddd56 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.356914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b3853-8fe1-4f85-b329-d9c6400ddd56 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.358798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 194/395] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:20.364573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.365250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.365743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.392833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:20.394457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:20.481519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 202/396] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:20.773615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b3853-8fe1-4f85-b329-d9c6400ddd56 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.795160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.904304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b3853-8fe1-4f85-b329-d9c6400ddd56 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.946982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.947616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.947894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.948166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.958954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:20.964729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:20.965603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:20.966566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 195/397] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:20.971956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.995160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.090943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311e9e3-2e5c-4cfb-93ca-f6e78b74300a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.131582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.132253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.133241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.133524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.134294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:21.134596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.136102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e436b3-c21b-4dc5-af7b-4cba731601d8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.146678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 203/398] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:21.152732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.237562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.260296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea921-fa05-4bdf-9216-152ed2f846a7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.265213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f027-d072-4bc2-89ad-dbae615ef799 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.267399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f027-d072-4bc2-89ad-dbae615ef799 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.267399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f027-d072-4bc2-89ad-dbae615ef799 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.267399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 204/399] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:21.275990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.276486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.276863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.297258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:21.301118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:21.313307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.314014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.314295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.314622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.316434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.318008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.320679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 196/400] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.327132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.421509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 205/401] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:21.482978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e771f8-719d-4d29-b6fb-238bf996ac9d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.531534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.532172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.532456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.532789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.534016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.535475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a252-9ddd-43a3-b79b-0a7f95172029 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.537433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 197/402] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.543362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.558894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.661199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef4a2-6ac0-4c7f-91ea-e2bef4a5111b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.717396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.718096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.718370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.718635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.721184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, group_id=7aefb7c9204741de9a3f6405ec2d3b5d, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.722711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.755534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6137-3ff9-4b9a-a0d0-5309c7293bc6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.755534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6137-3ff9-4b9a-a0d0-5309c7293bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.755534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6137-3ff9-4b9a-a0d0-5309c7293bc6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.755534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 198/403] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:21.762384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.762921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.763391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.782355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:21.784414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:21.795626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 206/404] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:21 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:21.796807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.852176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.870062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 199/405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:21.982450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.003720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96db585-960f-42e9-ac80-80934f13a49e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.053720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.054874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.055158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.055432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.070341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.075190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.076129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:22.077483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 207/406] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:22.082324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.200690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d37e0c-bfd1-4b8d-8eff-b815068156b3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.236000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.244370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.244989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.245269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.245551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.246257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.246561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.247934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.263394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 200/407] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.268791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.280327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.346120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67737e39-149c-4e56-a3ba-b49c566193b6 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.384682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.385612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.386070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.386585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.397899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.406138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.407581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.408434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.409195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:22.412076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 208/408] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:22.417705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.512386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f14113-bce4-4eeb-9437-5a09d41749d5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.531128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baea20-10bf-4b8a-9d81-11a8566d67ef None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.568850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.569829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.570851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.571331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.572266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.572849 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.574524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.577380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.578042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.578325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.578598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.582707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.584160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.585001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 209/409] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:22.585918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 201/410] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:22.595500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.595682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.693917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.740733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.787674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45ab84-1d3d-4286-b0d9-be20d45da8e8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.788280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2e48-a0d5-44b6-9956-5037f8792c19 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.824842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.825037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.825467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.825586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.825757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.825862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.826048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.826160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] PATH_INFO: `/v3/groups/15151af876b84f1db915adc138d65dec` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.827177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.827283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] RBAC: Authorizing `identity:get_group(group_id=15151af876b84f1db915adc138d65dec)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.828627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.828733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978adb-4d89-4093-a98f-d9a1a3e34613 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.830267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 210/411] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.830460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 202/412] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/groups/15151af876b84f1db915adc138d65dec => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.831549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0efed2-a2cd-4639-a6f4-aad7fe5b4bfa None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.831830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0efed2-a2cd-4639-a6f4-aad7fe5b4bfa None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.832218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0efed2-a2cd-4639-a6f4-aad7fe5b4bfa None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.836335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.839225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 211/413] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:22.839988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0efed2-a2cd-4639-a6f4-aad7fe5b4bfa None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.943419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0efed2-a2cd-4639-a6f4-aad7fe5b4bfa None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.946483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead1a68-3a16-4ae0-ba39-5175cc3bd259 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.965100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.979229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.980022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.980484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.980829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.983225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9dab2586954d1097f046a8337e6f06, group_id=7aefb7c9204741de9a3f6405ec2d3b5d, role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.984832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.986611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.987417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.988419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.988837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] PATH_INFO: `/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.990323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] RBAC: Authorizing `identity:get_project(project_id=bcc2c09443be4848acb9a6d8fb8bb990)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.992437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31490f-8a20-4b72-99b5-e728b5c99744 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.999338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 203/414] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.000196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2860ff-9ae6-477f-888a-5d2640b26e7e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.000624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2860ff-9ae6-477f-888a-5d2640b26e7e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.000899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2860ff-9ae6-477f-888a-5d2640b26e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.024559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6c2860ff-9ae6-477f-888a-5d2640b26e7e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:23.041605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 212/415] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:22 2022] PUT /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06/groups/7aefb7c9204741de9a3f6405ec2d3b5d/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:23.041605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.041869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6c2860ff-9ae6-477f-888a-5d2640b26e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:23.043776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.119038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 204/416] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:23.120402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75871f77-d174-4bd6-bd9c-df477d8817e1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.120694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75871f77-d174-4bd6-bd9c-df477d8817e1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.120968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75871f77-d174-4bd6-bd9c-df477d8817e1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.126594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 205/417] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:23.127914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.128323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.128604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.167254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:23.168475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:23.175173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a302351-7531-439f-b3cd-264e7392cace None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.236990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.238119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.238636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.239103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] PATH_INFO: `/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990/groups/15151af876b84f1db915adc138d65dec/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.241246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcc2c09443be4848acb9a6d8fb8bb990, group_id=15151af876b84f1db915adc138d65dec, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.244896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.277733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 206/418] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:23.332577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 213/419] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:23 2022] PUT /identity/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990/groups/15151af876b84f1db915adc138d65dec/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:23.424136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.522464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.563332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2de62-c579-4891-a60f-027385c96ec6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.574718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.602710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.603582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.603993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.604408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.616717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:23.621762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:23.622839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:23.623827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:23.626120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 207/420] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:23.632273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.636150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.747266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448439fb-131c-437c-ae02-13731ec2d1d2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.792055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.792922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.793372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.793799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.805481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:23.811770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:23.812926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:23.813888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:23.816212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 214/421] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:23.821558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.821689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428bb1a-8aa1-4def-8d61-d879a00fe34c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.882377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.898856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.899943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.899943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.900167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.900762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:23.901066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.902464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.926720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 208/422] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:23.930332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.934283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.937556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17179ae6-b2fc-43f3-82f0-6da1c53cad4b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.980065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.981320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.981748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.982187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.983019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:23.983460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.985768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.995630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 215/423] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.000799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.116730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508d33-fd8b-44e5-8ed5-594715f540fb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.151452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.151977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.152303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.152584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.186317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.191870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ea1ae-4554-4f27-aeb1-6759946efcc3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.231925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.233390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b1840-cf46-44aa-8c95-8af56eb354a0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.254875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.255925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.256209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.256764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.331265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.335457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 216/424] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:24.337014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f651c47-7c82-4d6f-9ed8-0b1130f099f0 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.337509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f651c47-7c82-4d6f-9ed8-0b1130f099f0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.338040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f651c47-7c82-4d6f-9ed8-0b1130f099f0 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.358411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 217/425] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:24.358551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.358551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b24b80-7d37-411b-9f55-26bd2a924d38 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.359775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f651c47-7c82-4d6f-9ed8-0b1130f099f0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.419813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.471492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 209/426] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:24.473291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.473782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.474277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.475330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f651c47-7c82-4d6f-9ed8-0b1130f099f0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.494555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:24.496267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:24.517917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.518568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.518851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.519127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.520271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.522617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.525339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 218/427] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.526608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.578051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 210/428] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:24.579322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.628898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.651699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4e3f7-eacf-4fd2-a949-6a25076a5ecf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.718110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.718110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.718110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.718110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.718518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] PATH_INFO: `/v3/projects/e76740df8ff144189fca524ddccfe878` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.718518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] RBAC: Authorizing `identity:get_project(project_id=e76740df8ff144189fca524ddccfe878)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.718518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.725851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 219/429] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/projects/e76740df8ff144189fca524ddccfe878 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.727593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.781738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562349af-b927-4dc6-80d1-fef1ecbbf572 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.877650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4673-6d60-4449-b2ef-84f5dfcb3db6 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.894628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.895831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.896270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.896703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.902620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.904237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.906310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 211/430] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.907222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.916579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.917341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.917735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.918155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.919431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.921517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.923940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 220/431] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.925245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.010071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.016738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.023175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523922a1-c1e2-464c-9f41-4e74307649af None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.060545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.061182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.061464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.061742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.061922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1deb-be4e-49f4-95c5-381ccdeb0c66 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.073877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:25.078865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:25.079778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:25.080601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:25.084886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 212/432] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:25.085773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.102192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.103182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.103465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.103748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.104761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=e76740df8ff144189fca524ddccfe878) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.105075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.107017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.114958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 221/433] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.115764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.239187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a3535-6d95-42ba-b822-f05b2e0d0a04 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.283172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.283842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.284262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.284552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.285291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=e76740df8ff144189fca524ddccfe878) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.285599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.287345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13832c3-9118-4476-a22d-142c316dd440 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.296521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 213/434] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=e76740df8ff144189fca524ddccfe878&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.333535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a894ca-2844-4010-b0d0-d76e9b6f0ff1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.333847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a894ca-2844-4010-b0d0-d76e9b6f0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.334123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a894ca-2844-4010-b0d0-d76e9b6f0ff1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.334991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54f56a-6a91-4691-b944-08aefb8bf337 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.336299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 214/435] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:25.341628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036746e-2f4f-42c1-a09c-9c7cf37857b1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.341907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036746e-2f4f-42c1-a09c-9c7cf37857b1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.342219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036746e-2f4f-42c1-a09c-9c7cf37857b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.364964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2036746e-2f4f-42c1-a09c-9c7cf37857b1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:25.366359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2036746e-2f4f-42c1-a09c-9c7cf37857b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:25.370879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.380258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.382303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.384514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.384514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.384514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.384990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] RBAC: Adding query filter params (name=member) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.385447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.386667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.401482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 222/436] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.407315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.455890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 215/437] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:25.535061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac361cc-421c-44a5-a0f0-47473ff32075 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.574197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.575196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.575484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.575759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.639623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.655162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.656885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.660854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc808e3-69db-406c-a8cc-6ed89ae26745 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.661136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc808e3-69db-406c-a8cc-6ed89ae26745 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.661409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc808e3-69db-406c-a8cc-6ed89ae26745 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.662777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 216/438] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:25.673308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.673599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.673851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.703928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:25.705121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:25.778975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 223/439] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:25.779758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.799947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 217/440] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:25.806145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.894035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.897956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.906926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9922c62-c7e3-4f16-8cf3-3cfe136c7e95 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.925294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d7d5-4f97-418c-ad36-5904e292db6c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.958415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.959277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.959699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.960132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.967888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.968529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.968807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.969082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.970238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.971321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:25.971725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.973482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 218/441] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:25.976163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:25.977129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:25.977930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 224/442] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:25.979782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.983763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.091039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a738-64d5-483f-bb29-c86f34a99238 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.096834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c2f8-59d0-45dd-b5ad-fce04a9276e9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.126303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.126950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.127211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.127480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.128589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.129980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.130112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.130572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.130849 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.131120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.131807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 219/443] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.131916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.132080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.132398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.134089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.142880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 225/444] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.143678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.147884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.159753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.234101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5a56-bc98-4e3f-b8b3-0f31836321d7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.241792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e1fed-2b8f-4870-85b2-668bd5605712 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.267610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.268230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.268510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.268783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.275582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.276165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.276442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.276711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.277430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a173a3f73a994a4ba4a5df3459bfb165, scope.project.id=cc9dab2586954d1097f046a8337e6f06) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.277734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.278663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:26.279186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:26.283409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:26.284379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:26.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 220/445] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:26.286200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 226/446] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a173a3f73a994a4ba4a5df3459bfb165 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.286302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.291009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.364798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.385190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.404065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11c0e7-6ff0-4459-a460-9de6771a1d32 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.412873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e102-cc5c-4066-a071-b4e828c286f0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.449169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.450185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.450185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.450385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.457786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.458844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.459232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.459511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.460189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.460484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.461991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.471119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 227/447] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.477909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.531553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.533012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.603873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de761-1969-436d-86a8-e8fde925b1e1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.611547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.641131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.641667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.642019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.642286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.647859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 221/448] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:26.653572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.654812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.720057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.721970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.757740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11196dd5-938b-4b76-bc2b-d13d3edd2857 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.792455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.793068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.793343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.793610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] PATH_INFO: `/v3/projects/cc9dab2586954d1097f046a8337e6f06` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.794745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] RBAC: Authorizing `identity:get_project(project_id=cc9dab2586954d1097f046a8337e6f06)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.796163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.797754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 222/449] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/projects/cc9dab2586954d1097f046a8337e6f06 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.803287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.823357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 228/450] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:26.829079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.842147 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.869271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.901870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00658-a0ba-49ab-974d-59306214fcfc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.926497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf716d2-df12-45fd-a204-c93b266d121f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.935688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.936307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.936589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.936862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] PATH_INFO: `/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.938003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] RBAC: Authorizing `identity:get_group(group_id=7aefb7c9204741de9a3f6405ec2d3b5d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.939442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.941172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 223/451] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/groups/7aefb7c9204741de9a3f6405ec2d3b5d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.947290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.959618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.960237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.960515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.960787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] PATH_INFO: `/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.962477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] RBAC: Authorizing `identity:get_project(project_id=bcc2c09443be4848acb9a6d8fb8bb990)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.963911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.965525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 229/452] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/projects/bcc2c09443be4848acb9a6d8fb8bb990 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.970795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.051912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a873896-480d-4d6d-a96d-6e1263e9fc7b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.059889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.077702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5daf33-d1e4-49b4-b649-c84f6ed61690 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.087113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.087748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.088348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.088625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.088897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.089618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] RBAC: Adding query filter params (group.id=7aefb7c9204741de9a3f6405ec2d3b5d, role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=cc9dab2586954d1097f046a8337e6f06) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.089922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.091371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.097780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 224/453] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/role_assignments?group.id=7aefb7c9204741de9a3f6405ec2d3b5d&scope.project.id=cc9dab2586954d1097f046a8337e6f06&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.111972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.112612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.112888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.113158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] PATH_INFO: `/v3/groups/15151af876b84f1db915adc138d65dec` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.114378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=15151af876b84f1db915adc138d65dec)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.115857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524497f-8c99-486e-99ce-d5b82efef8b9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.118301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 230/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/groups/15151af876b84f1db915adc138d65dec => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.123762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.228246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007f211-73c8-4dfa-8541-e61bc13df1d1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.263039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.263649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.263933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.264211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.264942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] RBAC: Adding query filter params (group.id=15151af876b84f1db915adc138d65dec, role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=bcc2c09443be4848acb9a6d8fb8bb990) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.265251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.266715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4154c-b413-4b6c-ac05-82b31c051788 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.272534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 225/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/role_assignments?group.id=15151af876b84f1db915adc138d65dec&scope.project.id=bcc2c09443be4848acb9a6d8fb8bb990&role.id=15131bc73ffe4de98028e781cae256f3 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:29.865160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdab1-ba55-40f5-9705-b6e0e4a064e3 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.866023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdab1-ba55-40f5-9705-b6e0e4a064e3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.866439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fdab1-ba55-40f5-9705-b6e0e4a064e3 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.868455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 231/456] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.873638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc943d3a-0d77-4cc8-9935-d5f2a4e6d3b8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.874391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc943d3a-0d77-4cc8-9935-d5f2a4e6d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.874806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc943d3a-0d77-4cc8-9935-d5f2a4e6d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.899007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fc943d3a-0d77-4cc8-9935-d5f2a4e6d3b8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.900617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fc943d3a-0d77-4cc8-9935-d5f2a4e6d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:29.934641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ced50-ca2c-4a53-9119-7364e39c70d7 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.935280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ced50-ca2c-4a53-9119-7364e39c70d7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.935751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ced50-ca2c-4a53-9119-7364e39c70d7 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.937540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 232/457] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.941623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:29.942102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe225-3361-497f-8e59-8da6ff56cc4f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.942391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe225-3361-497f-8e59-8da6ff56cc4f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.942670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fe225-3361-497f-8e59-8da6ff56cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.979540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-529fe225-3361-497f-8e59-8da6ff56cc4f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:29.980928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-529fe225-3361-497f-8e59-8da6ff56cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:29.987685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 226/458] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:29.989194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49cbce-484e-4faa-b890-ee98d8a44807 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.989696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49cbce-484e-4faa-b890-ee98d8a44807 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.990207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49cbce-484e-4faa-b890-ee98d8a44807 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:29.991867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 227/459] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:29.998395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977e76-568d-4ade-b90e-d5b286073ab8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:29.998892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977e76-568d-4ade-b90e-d5b286073ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:29.999373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9977e76-568d-4ade-b90e-d5b286073ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.031432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c9977e76-568d-4ade-b90e-d5b286073ab8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.032955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c9977e76-568d-4ade-b90e-d5b286073ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.088811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 233/460] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:30.144557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 228/461] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.257499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c1795-042e-498c-bcde-14a9bf2d1f45 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.258074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c1795-042e-498c-bcde-14a9bf2d1f45 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.258499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c1795-042e-498c-bcde-14a9bf2d1f45 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.260276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 234/462] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:30.270908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.271229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.271513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.283602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c1795-042e-498c-bcde-14a9bf2d1f45 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.301983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.301983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.440798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 229/463] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.441432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c1795-042e-498c-bcde-14a9bf2d1f45 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.450114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.465064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.480682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.481780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.482116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.482945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.492120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.499007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.500757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:30.520301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:30.521203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:30.522505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:30.522505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.522505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:30.522505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 235/464] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:30.523846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.571470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053a1b1-9154-417e-9454-03f2b9bef2b5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.610223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.611143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.611423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.611692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.623622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.625074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:30.642191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:30.644345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:30.646564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:30.646564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.646564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:30.654186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 230/465] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:30.654407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231ba8a-36be-4885-b307-af0b39b91c82 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.654616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.692941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.692941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.692941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.692941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.706453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.708360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:30.728256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:30.729187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:30.730043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:30.730043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:30.730043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:30.732049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 236/466] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:30.733021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.745974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.751897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.775120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc0f7-05ad-4ed6-828a-815f39a1a0b7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.811233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.811842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.812122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.813095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.813095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:30.813317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.814761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.827406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 231/467] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:30.828072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.849504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a83eb0-1a0a-472a-9256-cedac36c1812 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.884983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.885611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.885860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.886134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.886777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:30.887071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.888445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.900601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 237/468] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:30.901405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.940988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7928c0-46d9-4e18-a1c3-563a6c88f5de None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:30.975023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:30.975881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.976199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.976478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.976573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.978052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:30.978365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:30.979745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:30.982097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.992486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 232/469] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:30.994325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.010702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a4b4b-3d05-4b4b-b68d-d197a51f9580 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.046801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.047345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.047625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.047899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.058845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.060359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:31.074224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:31.075120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:31.076548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:31.076548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.076548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:31.076548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 238/470] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:31.076548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.103834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83dcc-4493-4e0d-ad7c-1b802490492c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.139368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.139975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.140259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.140532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.141168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.142646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.180531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0d3c-76d9-4324-9ea3-262d76d83200 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.202773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.214542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.215165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.215434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.215702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.216324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.217746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.249487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 233/471] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:31.250331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.308336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.326950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 239/472] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:31.334096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.370832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4e76d-2a59-4ee4-bf11-0d37284cd8e1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.421888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.422543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.422846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.423194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.423847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.425328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728dec7-b7fa-4226-ba9a-6552aad0fecc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.493290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce073-8ad9-495f-bbd5-ad7e594bfda8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.508930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 234/473] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:31.510662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450391-9a05-470c-b052-2279a2799d00 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.511149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450391-9a05-470c-b052-2279a2799d00 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.511715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450391-9a05-470c-b052-2279a2799d00 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.513520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 235/474] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:31.523191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.524355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.524649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.543799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.544429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.544713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.545116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.545807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.546410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.549077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.553490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:31.554792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:31.564803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 240/475] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.571028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.620221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.654126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 236/476] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:31.697329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5dba-c667-48ac-b770-8a53c2998635 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.737588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.738350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.738631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.738904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.739553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.741285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.839672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 241/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:31.932951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.987389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.066067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8dcb0-3849-4639-932c-7dc84215863a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.112634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.113246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.113524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.113800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.114500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.115885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.153078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.sql.core [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.153078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:26:32.153078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [parameters: {'id': '62eb87e900304592bf83857324574893', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:26:32.153078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81741) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 03:26:32.172194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:26:32.173101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application yield resource Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise self.value Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application session.commit() Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:26:32.174013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:26:32.174861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:26:32.175719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:26:32.176512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [parameters: {'id': '62eb87e900304592bf83857324574893', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:32.177312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:26:32.179525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:32.182097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 237/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:32.188098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.287745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.300952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd9c58-7d48-4bb9-99e0-aa02804a9ef7 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.345451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.346112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.346396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.346668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.367241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f70d0f72-5158-4396-96b6-8aa99017fb53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:32.372475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:32.373333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:32.374168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 242/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:32.379337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.517906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c80ac9-53af-4644-9bcd-c89acb25b9fe None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.519486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.566599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.567209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.567490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.567767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.568435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:32.568740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.570156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1909c8-e8c4-4ea2-b822-23222fe58eff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.581213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 238/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:33.620082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab2cc-8bc8-47fd-a050-df0830b5dd6f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.620634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab2cc-8bc8-47fd-a050-df0830b5dd6f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.620634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ab2cc-8bc8-47fd-a050-df0830b5dd6f None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.622249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 243/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:33.627576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c759e7-26f9-4a1a-9f05-4da57c6efb45 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.627996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c759e7-26f9-4a1a-9f05-4da57c6efb45 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.628188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c759e7-26f9-4a1a-9f05-4da57c6efb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.654924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f5c759e7-26f9-4a1a-9f05-4da57c6efb45 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:33.656110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5c759e7-26f9-4a1a-9f05-4da57c6efb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.726772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 239/482] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:33.792290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9600ba-d2d8-44e5-b75c-85a6b7841c12 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.792575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9600ba-d2d8-44e5-b75c-85a6b7841c12 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.792856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9600ba-d2d8-44e5-b75c-85a6b7841c12 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.794254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 244/483] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:33.804872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea94a-c626-4cd2-aa02-54d1da92e337 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.805190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea94a-c626-4cd2-aa02-54d1da92e337 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.805466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ea94a-c626-4cd2-aa02-54d1da92e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.827545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-564ea94a-c626-4cd2-aa02-54d1da92e337 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:33.828703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-564ea94a-c626-4cd2-aa02-54d1da92e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:33.924375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 240/484] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:34.025104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9600ba-d2d8-44e5-b75c-85a6b7841c12 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.115997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3ccd-3483-4d32-9a4e-4bb98cc7e439 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.116305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3ccd-3483-4d32-9a4e-4bb98cc7e439 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.116540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e3ccd-3483-4d32-9a4e-4bb98cc7e439 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.118745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 241/485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.123776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c933c7-64c6-4033-bbc7-17a701628c1d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.124099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c933c7-64c6-4033-bbc7-17a701628c1d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.124324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c933c7-64c6-4033-bbc7-17a701628c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.146278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e1c933c7-64c6-4033-bbc7-17a701628c1d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.150193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1c933c7-64c6-4033-bbc7-17a701628c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.173803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9600ba-d2d8-44e5-b75c-85a6b7841c12 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.182715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.214573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.215718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.216168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.216608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.230378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:34.232438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 242/486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:34.233984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711533ce-4615-42db-bb47-bc8d55b38229 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.234108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711533ce-4615-42db-bb47-bc8d55b38229 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.234418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711533ce-4615-42db-bb47-bc8d55b38229 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:34.239855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.240822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.242039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:34.243185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 243/487] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.243254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:34.243318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.243318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.243318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.249271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.270843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.275276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.283669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.357657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 244/489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:34.358556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.373143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045877f-bc14-4ba5-97d8-c0353d7b0f8e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.408171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.409113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.409620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.410143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.411028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:34.411528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.421397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.426851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:34.428355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.515963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.545479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918375a4-d1ce-4ab2-8fd9-4e666cffd930 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.573624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.592845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.593472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.593748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.594045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.597911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654319e-d9ae-4998-a0eb-bf2c675eda82 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.604829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:34.609536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.610409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:34.611843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:34.612506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.634722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.635395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.635625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.635901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.646993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.648435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:34.662823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:34.667591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:34.667591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:34.667591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:34.667591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:34.667591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.717064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915da4e-dd0e-4710-a1e2-8a8293db302d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.753747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.754404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.754681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.754951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.765209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:34.769928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.770868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:34.771655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:34.772319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.778507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f67c-834f-4ce7-bed6-36a2ab4f2a41 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.780722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.809925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.817633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.818376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.818673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.818945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.822765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:34.822765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.822765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.830755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.831566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.890803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf143c-d5cc-45f5-b00c-8e33ff5395a6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.927906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.928512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.928797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.929065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.929717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:34.930062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:34.931558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:34.939246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad529-a14c-40af-a78a-21c495124d9b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:34.943411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.944056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.976613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:34.977848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.978107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.978381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.990171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:34.995411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:34.996284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:34.997078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:34.997731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.017736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.053543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.061571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdfdb-4edf-424a-8040-35855ef3f5bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.097390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.098020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.098303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.098577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.099241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.099544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.100911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.107935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53235-9ae0-46e4-a1f4-68862d8b7431 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.114749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 248/497] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.114749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.148245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.148548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.148900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.149240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.159818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.161287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:35.176116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.176999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:35.177810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:35.177810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.177810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:35.177810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.178058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.222553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c32cb-6ca8-4125-971e-2c27443f1599 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.250232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.261243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.265556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.265556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.265556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.272426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.273911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.284340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822b387-2645-4bea-89d5-81fbb54ecb4c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.286072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:35.287459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.288508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:35.289673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:35.292772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 249/499] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.293615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.322708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.323332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.323685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.324033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.324783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.325162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.326623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.334626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.335683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.398853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bd0bd-c16b-4f44-aef2-ce2497786c1f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.434349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.434971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.435251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.435523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.439256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c39cf-f5f3-40d8-bbe5-4d93601279d3 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.445831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.447342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:35.461150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.462252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:35.463122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:35.463122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.463122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:35.463122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 250/501] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.463489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.474382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.474984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.475266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.475539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.476179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.476480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.478432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.490485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 252/502] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.491441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.512035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.518092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.578702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe84ae-4772-4fc7-938b-34e410d30889 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.593022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dfb6-a7cf-4c6e-96c2-6df3edf5af2f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.610932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.611867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.612151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.612448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.613169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.613467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.615000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77e23e-0ef2-42b7-8d84-2b9cae17cf13 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.626630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.627238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.627510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.627774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.638093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.639535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.652080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 251/503] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.653376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e047e35-1c34-4fe3-bc4b-880bb078e73c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.653665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e047e35-1c34-4fe3-bc4b-880bb078e73c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.653957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e047e35-1c34-4fe3-bc4b-880bb078e73c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:35.654075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.654867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:35.655720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:35.655720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.655720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:35.655720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 253/504] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.656193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.656425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 252/505] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:35.657322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e047e35-1c34-4fe3-bc4b-880bb078e73c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.741086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.756564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.763608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e047e35-1c34-4fe3-bc4b-880bb078e73c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.763862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561df68-e9ac-425b-aed8-e92fdbd42366 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.796555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.797152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.797261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.797487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.797743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.797832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.798053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.798327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.798962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.799260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.800645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.804679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.806663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.812722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 254/506] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.813515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b45dd5af-25b3-40d7-bfa9-cf649b7ceb9b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:35.818398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.819339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:35.820214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:35.824194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 253/507] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.825445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.825734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.826035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.843634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:35.844774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:35.914604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf48e9a-b690-4986-93cd-bc8706d9495d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.918355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 254/508] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:35.919103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.948814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.949415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.949692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.949986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.953414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.021177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.022664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.023316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.038624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8708ce8-7168-4557-af52-6f028c826a1c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.077034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.077633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.077910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.078208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.078846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.079187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.080598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.092702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 255/509] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.093722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.128160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 255/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:36.129002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.165456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.210752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14e014-57f4-438e-a339-f3f3b47c3f1f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.230059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee334-b444-43ae-8262-3dd30777e0b4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.247207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45083201-b4bb-446e-817c-316f7208797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.247841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45083201-b4bb-446e-817c-316f7208797e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.248143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45083201-b4bb-446e-817c-316f7208797e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.248398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45083201-b4bb-446e-817c-316f7208797e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.256720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45083201-b4bb-446e-817c-316f7208797e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.258210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45083201-b4bb-446e-817c-316f7208797e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.268048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.268648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.268924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.269191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.269923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-45083201-b4bb-446e-817c-316f7208797e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:36.270225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.271223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:36.272161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:36.272655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.272721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.272721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45083201-b4bb-446e-817c-316f7208797e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.274882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.282634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.312908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.312908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.382216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45083201-b4bb-446e-817c-316f7208797e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.405424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.412029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765d98-ada8-48d9-92c9-d87f870a55e0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.415457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.416072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.418527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.418527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.424694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.426284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:36.437517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.438473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:36.439351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:36.442266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.443325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.445341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.446596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.446868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.447134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.459850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.459850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:36.474107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.475005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:36.475861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:36.475861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.475861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:36.475861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.476071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.520868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.579401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d8a1-7c92-4d8b-87c4-ea7eec5ef56a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.600418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7193-f954-461e-bd13-aeefba172777 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.619234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.620317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.620597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.620871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.636413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.638804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.645419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.646482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.646767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.647039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.648189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.648498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.650114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:36.653804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.654831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:36.655659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:36.655659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.655659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:36.655659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.655866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.669895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.670757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.674257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.765678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b51a3-300c-443f-a537-cf90bab5c102 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.775532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981c2f5-4653-4bff-a20f-3b64dc2edc7a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.782299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.799185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.799784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.800056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.800325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.810439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.821472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.830620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 259/517] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.831411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.867621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.869585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.891487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.929564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041365-516f-4d91-be7f-e72dcc122be1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.963515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.964107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.964387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.964663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.965302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.965527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 259/518] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:36.965648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.966400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.967017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.984111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.984111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.986870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.067667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928761dd-41e1-4e33-b9e4-1e4eeaba9dae None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.081787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72456700-df82-4ca3-b3c1-bce38d7cc903 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.100526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.101113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.101395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.101664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.102865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.103170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.104526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.104712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.115749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 260/520] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.116015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.116532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.116641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.116873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.117213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.186690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.188049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.193762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.216080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe537-4505-4638-a4dd-92a870157d1d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.249611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.250224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.250502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.250772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.285662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 261/521] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:37.286517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.313877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.316554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.318029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.388008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636065-ad64-4150-a054-0d075778e77c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.396309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.419499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 261/522] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:37.420314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.422405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.423023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.424008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.424008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.433981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.435447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.450194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.451208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.452512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.452512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.452512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:37.452512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.452512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.520859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08182-8ebf-4de1-887b-2d04327457ce None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.531839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.554214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.554831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.555104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.555397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.555921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66dbb0-0f60-436c-9961-1a9c009af144 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.561906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.563391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:37.575282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.576192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 262/524] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.577102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.594140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.594746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.595027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.595298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.595987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.597490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.616063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.672865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c637b-b45f-4613-9ab8-e02728f8f938 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.697419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 263/525] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:37 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:37.697419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.715807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.716377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.716659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.716936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.729722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.731246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.748484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.749476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.750451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.750451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.750451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:37.750451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.750673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.819380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3ba1-741e-4078-ab35-0229f1d0447d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.856516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.857441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.864269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.864507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.864742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.865016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.867742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cd6ab-8877-47d7-8f9b-a2eac1756a55 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.881247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.883111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.900086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.906350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.907192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.907192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.907192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:37.907192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.907192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.910001 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.910740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.911104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.911352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.911999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.912305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.913671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.927025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.927864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.010491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ab0ed-a354-4aff-bded-e917f70ae8ef None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.041980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d26e1-d215-4a64-9949-0eb2ec234780 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.044184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.044778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.045054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.045321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.046048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.046347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.047772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.065495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.066352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.085174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.086103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.086587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.087152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.088100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.088579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.090444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.105980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.105980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.115459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.118522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.174161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0f2-26e7-40cb-a292-226011cc0274 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.211440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.211952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbc64b-be1c-4bd6-8aa2-d2822b9387f2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.212076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.212332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.212599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.213395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.213846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.215241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.231564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.231564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.254496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.255181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.255398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.255666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.262371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.263754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:38.274922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.275781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:38.276640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 266/532] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.277093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.339738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ffb21-b339-4b29-bff0-44d08f0a2f5e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.341283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.349212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.378845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.379441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.379721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.379991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.380711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=f7039ec3afcd41b7b006d1179e19cbc9) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.381017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.382243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad9aff-6300-42b8-b34c-c804dba1e362 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.382641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.393973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 267/533] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/role_assignments?user.id=f7039ec3afcd41b7b006d1179e19cbc9&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.393973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.419611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.420322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.420606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.420947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.429018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.431141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:38.444133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.448634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 267/534] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.449482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.530422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39054fe0-cedd-44a7-81fb-4b6c93adf98c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.563872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd235e9f-f562-4ff1-9849-8cfc049c89d1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.571841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.572301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.572653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.573001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.580795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.582479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.595603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:38.596492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.597386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.598276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:38.603112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 268/535] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.604013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.606830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.607627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.608069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.611614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.611614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.611614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.611614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.638366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 268/536] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.639622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.639902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.748707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76e20-88bc-4e30-b890-1c0715ad570c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.759365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08f58-5e32-4cdd-b58f-d07e1487de03 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.796103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.796705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.797057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.797413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.797661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.798279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.798676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.798778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.799228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.799670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.800412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.800833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.801384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.803060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.816630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 269/537] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.817496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.818389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 269/538] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.822019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.880134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.932439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.941021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c88203-cb7c-408e-978f-6f3bbc43ad73 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.949090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c42e7-4e8b-48fe-a811-68d687a50e36 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.984276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.984877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.985159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.985434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.986879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.987207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.988760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.995217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 270/539] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.996193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.997619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.998525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.999338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.000866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.001904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=634e36d89a344c1a87946891dbdbbfa2) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.002535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.004261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0f7b-878c-402f-85c9-8114b9670236 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.012959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 270/540] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/role_assignments?user.id=634e36d89a344c1a87946891dbdbbfa2&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.158719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfc73b-9ded-499f-b462-c3040b916972 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.180084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.212561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.213542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.214105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.214581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.215523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=b4a8cbc422f14bd2b284402085ca7050) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.216058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.217703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80f15-7a8f-40e5-9ba9-2ce14b00716b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.225664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 271/541] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/role_assignments?user.id=b4a8cbc422f14bd2b284402085ca7050&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.788288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296a2d6-d119-47c7-babf-15e2f507a933 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.788830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296a2d6-d119-47c7-babf-15e2f507a933 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.788830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296a2d6-d119-47c7-babf-15e2f507a933 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.790992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 271/542] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:39.796674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.796969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.797251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.816373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:39.817573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:39.904827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 272/543] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:40.216462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296a2d6-d119-47c7-babf-15e2f507a933 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.349350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296a2d6-d119-47c7-babf-15e2f507a933 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.384480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.385100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.385373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.385636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.395798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-039a92de-dc27-4bf5-bb6f-b00ef3eee8ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:40.400560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:40.401414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:40.402620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 272/544] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:40.407736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.512532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6db-bb53-4468-9dc5-12a5278d996e None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.512826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6db-bb53-4468-9dc5-12a5278d996e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.513007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6db-bb53-4468-9dc5-12a5278d996e None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.514259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182b9e6-de69-44db-80ad-59fd66f3f474 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.514374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 273/545] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:40.519335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.519622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.519902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.530944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.539512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:40.541403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:40.554438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.582246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.582853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.583124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.583390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.584052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:40.584390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.585716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.603757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:40.607123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.663475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 274/547] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:40.754005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0e85-6eeb-4d0a-97de-4242e2e41638 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.795656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.796221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.796499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.796774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.809143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.814679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:40.829014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:40.829913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:40.830854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:40.830854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:40.830854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:40.834173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:40.840625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.942884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.986854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.997765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a78c1-b0e2-4163-bc6a-47162381190f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.059371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.059905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.060187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.060460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.061124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.061428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.062829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.077595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.077926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027a21-5b24-412b-909c-c6993a053498 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.081859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 275/549] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.087696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.119807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.120818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.121319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.121800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.134941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:41.141806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.142936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:41.143729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:41.146447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 275/550] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:41.153756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.268652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220acd1-5933-43eb-b932-1415f0c33551 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.298431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.305718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.310110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.310110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.310110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.315454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.317000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:41.330660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.331951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:41.333081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:41.333846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 276/551] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:41.340170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.347569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b804-d7e8-4a23-bf69-55748c480591 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.421480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.447228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.447852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.448131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.448403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.449073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.449371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.450760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.464868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.470686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.471860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4c37-944d-4f62-b3ed-8ab18f2dc889 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.538344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.539989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.540343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.541162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.542183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.542845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.544774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c891eb1-1452-4193-9baf-fa0167cddc44 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.569213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.575523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f4fcf-b678-48c8-9aa9-a2c6a5bcb7a3 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.575523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f4fcf-b678-48c8-9aa9-a2c6a5bcb7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.575523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f4fcf-b678-48c8-9aa9-a2c6a5bcb7a3 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.577978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 278/554] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:41.578937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f4fcf-b678-48c8-9aa9-a2c6a5bcb7a3 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.612163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbee9d-3864-45df-8d8d-3ecad22f173d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.648913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.649732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.650219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.650605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.662099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.663684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.666534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-cc0c9f1e-f907-4757-950a-3e5dfc4c7e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:41.678998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.684325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 277/555] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.685371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.704016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f4fcf-b678-48c8-9aa9-a2c6a5bcb7a3 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.708825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:41.710050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:41.723216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.740259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.740934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.741134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.741410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.781964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 278/556] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:41.782835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.820562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.822538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0773-069d-4ccf-b3cc-b0e91bc8d175 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.892129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdfad0-89b9-44e9-bd6f-77229378869e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.920029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 279/557] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe867-c714-4ad3-b742-16917ed6eb56 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe867-c714-4ad3-b742-16917ed6eb56 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe867-c714-4ad3-b742-16917ed6eb56 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 280/558] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:41.930041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3adb30-405a-40c8-b13c-6dc3206c872b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.931396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3adb30-405a-40c8-b13c-6dc3206c872b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.931396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3adb30-405a-40c8-b13c-6dc3206c872b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.932441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 281/559] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:41.933192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3adb30-405a-40c8-b13c-6dc3206c872b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.938746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.939373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.939655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.939997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.940658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.940962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.942855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f39d5-121c-43fa-80a3-87367ad60b69 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.952637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.959874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 279/560] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.959874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493bc-5f08-4900-93d6-fd6ff54db452 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.959874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493bc-5f08-4900-93d6-fd6ff54db452 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.959874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e493bc-5f08-4900-93d6-fd6ff54db452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.975154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a5e493bc-5f08-4900-93d6-fd6ff54db452 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:41.976382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a5e493bc-5f08-4900-93d6-fd6ff54db452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:42.047419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3adb30-405a-40c8-b13c-6dc3206c872b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.053969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 280/561] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:42.053969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.053969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.053969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.075230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:42.076323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:42.093329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.094066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.094345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.094621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.104922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.106407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:42.121447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.122575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:42.123425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:42.123425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:42.123425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:42.123425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 282/562] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.123425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.154896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 281/563] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:42.156020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.210196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.216904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.250848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d94d-f6de-4391-b8ef-6aa76a25da92 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.275924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac717ff-1836-4296-ad94-19c7ac5657df None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.296182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.296808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.297087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.297358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.308437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.310191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.313347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.314167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.314585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.314995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:42.323111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.324261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 283/564] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.325322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.331505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:42.338168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.339163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.340017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:42.340674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 282/565] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.341309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.434725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae958-7d22-4ae7-b557-961c37df8a91 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.451061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda7039-76b1-436f-9977-c712d12370d7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.458317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.463363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.469040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.469633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.469909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.470205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.470837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.471133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.472564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.486156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.491318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.491318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.491318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.491559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 284/566] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:42.491559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.501102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:42.505779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.510033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 283/567] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.511000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.597452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50769f84-beb8-4a12-a1f8-5c688421c7e8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.609235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc214bcd-18a2-4f2b-a8e3-44ad58e6f43e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.632616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.633223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.633504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.634315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.635053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.635356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.636807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.654644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 285/568] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:42.655532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.658272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.658943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.659335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.659676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.660350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.660652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.662038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.674692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:42.674692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.708861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.710540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.759403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362996a-8521-4820-a29f-d61eea89a54e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.782155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ac7-e014-4bd9-8b57-d83adb9ed869 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.792707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.793325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.793605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.793879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.804027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:42.809726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.810712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:42.811540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 286/570] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.812209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.820301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.820935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.821719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.822038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.828848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.830318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:42.842591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.843625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.844507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.916587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89cd4-0a92-4642-8023-1e020f6ce067 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.925248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.930246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.941924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92246-ccc8-4480-829f-a2f868006ece None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.949856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.950498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.950833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.951120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.951783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.952085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.953455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.962902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 287/572] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:42.963831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.977131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.977763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.978078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.978353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.989801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.991340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.006250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.007494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.008420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.008420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.008420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:43.009371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 286/573] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.010388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.065272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b066b-5f76-4311-861a-8dad5c55b736 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.098353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.099024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.099308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.099582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.109146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c54411-5862-4060-aa6d-38cb8b9a6aa6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.110106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.112721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.128227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.129328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.130390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.130390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.130390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:43.130390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.130390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.146367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.147053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.147339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.147617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.148278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.148581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.149995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.155616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.157868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.158670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.161150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.230168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511276-399c-4e0e-b158-363ced1be6ef None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.257955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109fc23-4e90-4070-a101-979c4c210bca None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.265099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.265698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.266009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.266285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.266972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.267281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.268719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.279865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.280788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.296010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.296633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.296912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.297184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.308199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.309631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.324166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.325243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.326338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.326338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.326338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:43.329878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.330707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.361290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.379587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b67b7-12b6-4c5f-9d4f-7b7cea37cf2b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.385198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.413929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.414553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.414834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.415617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.416264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.416565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.417919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.428830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.429619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.431361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa7bc7-32c6-4027-b3f9-9f61849a669a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.466364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.466957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.470777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.470777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.470777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.470777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.470777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.481769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.482640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.552474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565f23c-767a-408b-a7f8-fb8d4b5b143c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.584961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a03c56-93f2-4f31-9b8b-aedad71a3477 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.586762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.587382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.587656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.587924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.598884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.599649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.600337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.602196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.615821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.616869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.618093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.618093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.618093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:43.619294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.620103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.620587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.621184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.621463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.621731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.622573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=eced38ac42be41fa8aa9be12ca4ebde3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.622878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.624286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.629687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/role_assignments?user.id=eced38ac42be41fa8aa9be12ca4ebde3&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.630490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.739174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92dc57-444a-43e3-b912-317efd43d73f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.746940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94832299-fe8f-463a-9da1-84d46af38016 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.779674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.780456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.781043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.781321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.782008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.782312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.783694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.785636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.786814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.787102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.787378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.795726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.800868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.800868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.801107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:43.815523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.816557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:43.817638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:43.823437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 291/583] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.824227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.863100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.868684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.908526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f29c-e69e-4b76-b997-5e8df98f76ab None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.930210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a003e3-32bb-4f00-99e2-a205a41b68dc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.944880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.945502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.945774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.946154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.953860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.955354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.967387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:43.967722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.968603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:43.969546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:43.970636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.970636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.970636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.970636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.970636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.970943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.973630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 293/584] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.974154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.989397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 292/585] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.989397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.088746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039832-22c4-4047-88b7-616e5bca3b16 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.103969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.107054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.110904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf232caf-fb3d-433f-89e9-af3c2dc5f848 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.128363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.129050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.129321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.129589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.138317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.140693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:44.152607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.153515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:44.154450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:44.154986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.154986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.155159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.155159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.158506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.158984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.160365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.160857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.162852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.181540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.182428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.255695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55287b3e-df71-47c3-80f9-050fbf7edf69 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.284669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83cd77-d4bd-4666-a7b8-ab43547ce6b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.290444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.291040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.291315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.291581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.292324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.292622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.294059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.313742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.314462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.331002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.331643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.331919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.332190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.342181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.343689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.355994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:44.358992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.359913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.360823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.385374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.434631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4c965-556d-4d73-85c6-d864f343c12b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.470412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2aa6b-5034-4b0a-b19b-3ed739cce29c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.470737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.471338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.471618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.471895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.472625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.472934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.474402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.491471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.492518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.521718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.522343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.522626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.522901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/f7039ec3afcd41b7b006d1179e19cbc9/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.538716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=f7039ec3afcd41b7b006d1179e19cbc9, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.540161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.587209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.601120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d8de0-87b8-4fe8-9490-9a66b05088c4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.634778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 295/591] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:44 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/f7039ec3afcd41b7b006d1179e19cbc9/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:44.635876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.647221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.648250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.648820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.649353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.662477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.665834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:44.689844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.690981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:44.691858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:44.691858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.691858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:44.700845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 297/592] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.703104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.771432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.816802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c15d9-aff2-4685-9fdf-4afb4c603f10 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.837924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e7f2-a682-4fa4-a4a7-d96fcca9a001 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.862303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.862915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.863198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.863475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.864208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.864513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.865958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.883979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.885911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.886640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.886992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.887359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.889687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.900550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.902467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.904709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:44.921823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.922797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:44.923660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:44.923660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.923660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:44.924889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 298/594] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.925003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.025201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a3397-a2c3-4444-b52d-4dbfd6bf8b65 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.053453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.062589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc0a02-388a-4805-b467-15e3e30c8acc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.066177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.066177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.066177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.066177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.066676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.067174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.068689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.081013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.082134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.105216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.105904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.106224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.106500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.119230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.120685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:45.136415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.137567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:45.138828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:45.138828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.138828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:45.138828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.138828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.192027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.196655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1493f4-a454-4945-b56b-23f15752d25f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.246016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.246627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.246904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.247177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.247826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.248126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.249505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.260587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1a321-13b6-49d0-a695-b27206b23a50 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.262539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 298/597] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.263876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.309137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.310163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.311076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.311594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.316299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.321816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.324038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:45.339897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.340869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.341817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:45.344484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 300/598] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.345507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.382995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09b908-f664-401a-ac1d-134e036ece85 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.420042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.420791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.421171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.421533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.422347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.422786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.424249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.437059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.438122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.481163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c4c0a-a127-405b-a991-57d1d1723e8e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.489333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.517922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.518826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.519222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.519595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.526628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.528647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:45.541298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.542394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.543451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:45.549466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 301/600] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.549466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.571615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7bc27-90f5-477d-80a5-d1f18f08cc96 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.580285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.606911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.607658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.608065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.608438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.609221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.609771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.611643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.625435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 300/601] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.626567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.657045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7296-47a4-4d74-91fe-695316f77085 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.703025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.703685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.703967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.704237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.711476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.712957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-9baa7227-8480-4b5e-9906-c3f84d60cd36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:45.725179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.726165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:45.727068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 302/602] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.728676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de3f8-ba89-4162-871d-00b38685c6d7 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.728676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de3f8-ba89-4162-871d-00b38685c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.728676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de3f8-ba89-4162-871d-00b38685c6d7 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.730057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 303/603] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:45.730561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de3f8-ba89-4162-871d-00b38685c6d7 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.746781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144da3-9e7e-4203-bc5f-2b388c60d989 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.763351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.784804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.785411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.785705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.785974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.787726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.787726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.788431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.805685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 301/604] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.805685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.838466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.842875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de3f8-ba89-4162-871d-00b38685c6d7 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.880064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.880720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.881002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.881274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.896743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=39cdc5dd5bdc44379c4504de359775c6, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.898218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.913673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd6d50-6ae0-450d-8ff9-57ee5aafb69f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.945764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.946385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.947177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.947448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.948137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.948437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.957743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2a858-b361-4445-8232-9b69052cd856 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.961449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 302/605] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.963162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.963444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.963769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.981380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:45.982596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:46.020556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 304/606] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:45 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:46.020556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.078086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 303/607] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:46.079188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.122633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.125059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.154826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a828b-a6b5-4ac7-b6f3-872081b6dab4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.208855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.211185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.212538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.212815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/634e36d89a344c1a87946891dbdbbfa2/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.233417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=634e36d89a344c1a87946891dbdbbfa2, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.234810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.276937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b23d5-7abb-4471-92c5-600d0f2ef298 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.313149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.313809 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.314165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.314443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/b4a8cbc422f14bd2b284402085ca7050/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.330548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=b4a8cbc422f14bd2b284402085ca7050, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.332041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.348726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 305/608] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:46 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/634e36d89a344c1a87946891dbdbbfa2/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:46.411177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 304/609] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:46 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/b4a8cbc422f14bd2b284402085ca7050/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:46.412990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.548399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca034-24ed-4d34-80f5-48c31d406fc1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.578624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.588463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.589114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.589454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.589992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.603375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f3c3813d-d098-4ee6-8e58-6a1e169728b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:46.608184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.609235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:46.610099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 306/610] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.615666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.696439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.723448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936911-6906-409c-becb-2c4a64aa84d8 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.723737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936911-6906-409c-becb-2c4a64aa84d8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.724018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936911-6906-409c-becb-2c4a64aa84d8 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.731773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 307/611] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:46.737888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389edbb0-58ea-4b89-bdb9-f8c782db5519 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.738638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.738923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.739198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.775007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:46.776226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:46.780937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.781725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.782208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.782652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.783516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.784066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.785634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.794891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 305/612] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.807260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.903123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 308/613] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:46.962705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9325437-da5d-4a43-90af-f2f70e452a1c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.990290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.998454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.004875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.004875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.004875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.010283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.011725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:47.026465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.027424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:47.028744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:47.028744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:47.028744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:47.028744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 306/614] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:47.035834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.157853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5a3f-18c9-4597-b34e-2b34ed037d6e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.176498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.195952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.197445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.198054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.198533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.199467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.200022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.201594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.215697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 309/615] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:47.221504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.350733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.354194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb66ec-746f-4321-bc43-6823f5fc07f2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.406378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.407616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.408134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.408635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.421387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.424037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:47.437380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.438426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:47.439565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:47.442389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 307/616] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:47.449193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.532757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.555329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde155a6-15e4-4c2d-a490-9b1102f120c9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.598027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.599074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.599640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.600118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.613478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:47.619296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.620210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:47.621046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:47.623766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 310/617] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:47.629617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.643335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d621e-9df4-4d09-85a5-d78cbd806a8b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.671283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.689101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.699182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.715923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 308/618] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:47.722483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.835910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.840730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914abbe-a66a-42a3-a569-0352254003eb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.857543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065662-4202-45c4-8e1b-64f733070684 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.887128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.887920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.889462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.890740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.913358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.914843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.933888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.934919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.935205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.935482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.936162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:47.936466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.937839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.948580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 311/619] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:47.951922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.952838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:47.953719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:47.953719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:47.953719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:47.953719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 309/620] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:47.960177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.961753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.118249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42d3af-2fc6-4e4a-8348-e46be9203cbc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.158815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.161172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.161688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.163478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.181480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.186474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.188352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.190432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6dc4d-161f-449b-8190-33f6fde82b09 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:48.223591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:48.224908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:48.225779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:48.225779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:48.225779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:48.235680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 310/621] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:48.239508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.245591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.270151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.271169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.271706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.272275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.273152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.274159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.277069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efc0d8-5b99-48e5-9766-dca9b9d43bc8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.296519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 312/622] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.302463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad6a4-a08c-4180-8862-fc400e89976d None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.303068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad6a4-a08c-4180-8862-fc400e89976d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.303568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad6a4-a08c-4180-8862-fc400e89976d None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.305371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 313/623] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:48.306358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad6a4-a08c-4180-8862-fc400e89976d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.376192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94813c-29e4-4d23-809b-76228a77858a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.411516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.412129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.412408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.412686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.413656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.413987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.416634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e5b38-4790-4ab2-911e-947eb3c46310 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.421646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad6a4-a08c-4180-8862-fc400e89976d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.436965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 311/624] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:48.436965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.436965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.436965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.455887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:48.457246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:48.468257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.469225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.469710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.470221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.477724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.480060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:48.492662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:48.493618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:48.494549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:48.500316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 314/625] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:48.500316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.520182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.533144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.553976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 312/626] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:48.553976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.668654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a1b7-6b6e-4995-af4a-05894c118f7f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.674792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d827-5c18-4990-a8b3-3f39ebd31c75 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.719942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.720715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.721291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.721571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.722386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.722700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.724570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2758-7d9d-4955-a4fe-a16c195ea989 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.738626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.739244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.739520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.739806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.740151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 313/627] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.741522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f42f-7e8d-424a-beed-62f2ccfee057 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.742081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f42f-7e8d-424a-beed-62f2ccfee057 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.742363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f42f-7e8d-424a-beed-62f2ccfee057 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.744515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 314/628] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:48.747083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207827-0ba3-479e-a70d-facfcd492318 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.747361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207827-0ba3-479e-a70d-facfcd492318 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.747639 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207827-0ba3-479e-a70d-facfcd492318 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.748969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 315/629] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:48.749705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0207827-0ba3-479e-a70d-facfcd492318 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.751856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.753641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-c6ae39d8-8971-4376-9063-a236fb6dfcc2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:48.765806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:48.766768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:48.767794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 315/630] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:48.768382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0dff6-1097-4669-a3f4-347502e08454 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.768382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0dff6-1097-4669-a3f4-347502e08454 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.768614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0dff6-1097-4669-a3f4-347502e08454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.787160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6ea0dff6-1097-4669-a3f4-347502e08454 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:48.788539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6ea0dff6-1097-4669-a3f4-347502e08454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:48.808184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.862292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 316/631] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:48.862483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0207827-0ba3-479e-a70d-facfcd492318 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.862594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.862594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.862594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.879549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:48.880742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:48.882872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.904285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.905459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.906045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.906469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/eced38ac42be41fa8aa9be12ca4ebde3/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.924491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=eced38ac42be41fa8aa9be12ca4ebde3, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.925856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.951285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 317/632] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:48.952130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.001923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 316/633] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:48 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/eced38ac42be41fa8aa9be12ca4ebde3/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:49.003541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.068049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e02ef4-1d99-4dcd-99e1-85f4985d9c30 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.119654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.120280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.120574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.120825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.121586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.121888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.123520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.146220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.159609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804efb-5084-402b-bb55-273828458ab0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.161999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.162931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.164600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.213605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.214817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.215528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.215834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.228660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:49.234861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.235779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.236618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:49.240389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 317/635] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.241631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.309614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b75a3-e117-47f5-a171-362ee20802df None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.347782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.348739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.349018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.349307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.357371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fdf8f-8641-4c4a-be8c-26ed89d5e21b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.359832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:49.364925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.365888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:49.366769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 319/636] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.367469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.404398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.405037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.405323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.405601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.430422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.440341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.478852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1dc1d-50f3-45a3-84dd-ffbe60698de8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.480774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.483287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.517462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.518102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.518385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.518659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.519325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.519663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.521015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.529098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 320/637] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.529976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.599549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 318/638] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:49.600434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.637195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65263-58fa-4818-944f-82d2b6bcdb57 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.655056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.664558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.672827 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.673460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.673743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.674105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.684962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:49.689655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.690631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.691467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:49.696196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 321/639] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.697682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.714235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c676-2646-460c-a197-2843ff9e8656 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.752604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.753145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.753425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.753699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.754391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.754693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.756079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.765006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 319/640] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.765006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.811491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455b4-2707-4bf7-94d6-31c771382c35 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.845395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.846063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.846381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.846661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.857071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.858538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:49.873142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.874118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:49.875024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:49.875024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.875024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:49.875024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 322/641] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.875024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.883071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f03ab-275f-4ac0-b812-9b2fbb60ad19 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.908186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.909993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.921895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.922574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.922857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.923134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.934469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.935948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:49.951868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.957470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:49.958493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:49.958493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.958493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:49.958493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 320/642] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.958493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.986603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4521-d837-4c52-b7f3-3d470dbec1d0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.023766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.024287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.024564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.024837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.025492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.025791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.027246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.040163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 323/643] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.040163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.070408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555734bf-a88c-4717-b80c-ece6af281fd9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.110944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.111578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.111850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.112375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.123702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.125152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:50.141467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.142538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:50.143501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:50.143501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.143501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:50.147528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 321/644] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.147659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.148420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.156748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd14d9-1ad3-44ef-8d22-70c310e12552 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.183407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.193601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.194229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.194507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.194776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.195411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.195707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.197102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.208247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 324/645] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.209040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.265645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf585-59bb-42cc-94c4-ccdd05ffea46 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.300867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.301636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.301924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.302224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.302863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.303164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.304535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.315211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88e685-7db2-488d-af99-7013d7ef66f5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.317762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 322/646] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.317762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.356314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.356933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.357231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.357470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.369671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.371141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:50.385271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.386256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:50.387135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:50.387135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.387135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:50.387135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 325/647] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.387135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.392038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.421049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.433075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01939701-defb-42dc-92cd-3f41b3659f38 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.484393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.485025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.485305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.485583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.486255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.486559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.488176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.494303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741c98-5608-494d-9bde-cc1cbb8de953 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.504800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 323/648] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.504800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.533120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.533737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.534038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.534313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.542371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.543814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:50.555142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.556183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:50.557109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 326/649] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.557688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.613867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd28e1-920d-4694-8b74-b2cdac439fbc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.623185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.649653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.650895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.651184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.651463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.659750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.661271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.663344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb48e9-28fa-4be0-9b87-3265de86761c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:50.673298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.674237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:50.675137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:50.679685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 324/650] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.680516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.695733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.712547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.713202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.713478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.713752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.714421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.714716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.716073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.728246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 327/651] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.729033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.793691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9c2f-3510-442f-a93a-5cd47cd54fd8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.829855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.830491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.830773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.831051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.836114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd2e8f-8625-40cd-b2bb-74ca45c337fe None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.838812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.840352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:50.851492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.852429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 325/652] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.853522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.868176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.879934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.880538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.882735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.882735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.882735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.882735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.883510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.906022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 328/653] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.907275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.930492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.967225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162f7e0-e990-4d79-8adf-464df1dc74a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.003620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.004221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.004499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.004771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.005459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.005759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.007234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.008825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24da63-0548-4bd8-9cfa-37a65d195bc5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.019626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 326/654] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.020423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.043804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.044433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.044714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.044989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.051969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.053401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:51.070938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.072140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:51.073189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 329/655] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.073833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.117400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.123399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c11a0-368f-4d12-9cd8-e72c88cda480 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.150543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.158277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.158959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.159233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.159501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.160240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.160536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.162006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e30c4-247c-4432-abd8-d1c399c46f6f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.179457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 327/656] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.179870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1e4f5-2e2d-47ed-9683-66d8242c3253 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.180625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76206d-a8c1-455e-a878-2d5d689f3237 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.180907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76206d-a8c1-455e-a878-2d5d689f3237 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.181223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76206d-a8c1-455e-a878-2d5d689f3237 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.182935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 328/657] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:51.183681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76206d-a8c1-455e-a878-2d5d689f3237 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.217890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.218507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.218784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.219051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.282590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76206d-a8c1-455e-a878-2d5d689f3237 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.285282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.286775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.315798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.316382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.316659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.316927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.317636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=f7039ec3afcd41b7b006d1179e19cbc9) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.317956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.319378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.324928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 329/658] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/role_assignments?user.id=f7039ec3afcd41b7b006d1179e19cbc9&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.325699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.336335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.391400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.396388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 330/659] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:51.397395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.451271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742598a-ea23-4573-89b7-a0306e3d0e90 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.493720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.494423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.495116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.495393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.496148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.496457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.498669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8642c5-b96d-4424-a1c5-4a5bf96fdb01 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.516931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 330/660] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.518435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.518722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.518999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.519492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94408eb-69ba-4a45-95df-93eefea215e2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.539873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:51.541773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:51.561844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.562714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.563154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.563426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.585550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.615374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 331/661] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:51.615374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.652635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.654483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.656611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.728020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b29e92-90a0-41a0-907d-182fab2e3242 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.762162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 331/662] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:51.763346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.776972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.777602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.778216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.778696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.791235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.793177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:51.811311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.812558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:51.813459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:51.813459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.813459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:51.817362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.818278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.834592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.906938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd731f1c-6551-4a8a-8b0d-8645f7b9832d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.929014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.939551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd158a-7596-4422-b003-974792c220a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.947651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.948304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.948583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.949794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.975228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.975851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.976135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.976409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.987663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.989094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:52.003508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.004610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:52.005476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:52.005476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.005476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:52.005476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 333/664] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.005476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.027073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.028745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.072469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.113357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e789-39b9-4c40-b0b8-2c56a6d0807d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.131565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 332/665] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:52.132232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.153071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.153676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.153984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.154249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.154890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.155190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.156560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.172983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 334/666] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.172983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.176279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.246848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcb21d-757c-4425-8a0c-07aedd86a4fc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.281066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27e8de-d326-44c1-91c7-8d6ff222b02b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.282578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.283321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.283674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.284015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.294719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:52.299454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.300537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:52.301506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 333/667] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.306832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.310138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.323442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.324192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.324579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.324859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.325506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.325814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.327237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.343270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 335/668] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.343270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.408767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.419367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f505d79-483a-4b78-a10c-8d7f4a293143 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.448857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9415-d198-4285-b3ca-20a51741e3c2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.456619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.457246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.457526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.457799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.469535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.471160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.484682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.485380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.485666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.485963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:52.488384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.489358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:52.490293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:52.490293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.490293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:52.490293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 334/669] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.490525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.501875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.503786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:52.516711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.517603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 336/670] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.519163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.557916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.606058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b5d4-3ae2-4559-894d-6e1b9fb70a92 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.625735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d3fa9-9f5b-4a5b-bbc1-3a0c4ddc3577 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.642354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.642957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.643243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.643519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.644192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.644497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.646010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.648777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.660041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 335/671] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.660041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.667552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.668185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.668463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.668768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.677660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.679286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:52.691082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.692065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.692931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:52.697127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 337/672] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.697998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.771566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd395a67-f491-4760-8d81-9f00304a0b12 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.791956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.808110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211fa12-4bce-46a7-ab65-4f9a81531780 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.809823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.810459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.814966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.814966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.814966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.814966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.814966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.825076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 336/673] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.825861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.852125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.852740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.853023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.853880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.854617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.854925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.856360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.869055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 338/674] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.869925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.918745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.937529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2742c3a-4672-4e91-aa9b-88aafc4ba442 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.980263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.981375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.981926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.982229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.983540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673aab-a35d-41d5-814b-498a52556977 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.995463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.997473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:53.016781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.017995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:53.019270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:53.019270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.019270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:53.021068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.021731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.022009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.022260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.022638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 337/675] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.023248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.023352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.023612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.025540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.045918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 339/676] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.045918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.059520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.135431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832d61c-ff34-460d-bbf7-bbfd0fb9552d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.147298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844292d-2936-45c7-82ee-c8710695a139 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.148822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.172459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.173395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.173878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.174420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.181875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.183516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.183942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.184115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.184395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.184670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.185439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.185755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.189005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.195386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 340/677] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.195386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:53.209041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.211209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:53.213912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:53.215506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 338/678] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.216473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.323743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07185e94-cd79-49f7-abb6-70900d54611a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.347106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.361489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a86023-f27e-4eef-8f25-a11272f48d8f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.375751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.376573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.376859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.377132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.377780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.378126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.379673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.393703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 341/679] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.394986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.402108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.402799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.403158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.403503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.404309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=b4a8cbc422f14bd2b284402085ca7050) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.405193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.406945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0993e04-ed0d-45f8-a558-5c3b7d3c25f2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.416402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 339/680] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/role_assignments?user.id=b4a8cbc422f14bd2b284402085ca7050&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.417987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83253ee-9ebf-457b-8fa4-ff613930da84 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.418105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83253ee-9ebf-457b-8fa4-ff613930da84 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.418881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83253ee-9ebf-457b-8fa4-ff613930da84 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.424233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 340/681] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:53.424233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83253ee-9ebf-457b-8fa4-ff613930da84 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.430112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.540587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3b46c-19b7-440b-9cc8-f58a8138dcae None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.542906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83253ee-9ebf-457b-8fa4-ff613930da84 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.581535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.582242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.582530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.582806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.586909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.587518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.587840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.588110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.588802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.589107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.590387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.590566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108061-62e1-4ed5-bb21-719075feef70 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.591883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.602962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 342/682] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.604261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.604546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.604823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:53.608613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.609527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:53.610504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 341/683] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.612911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.628846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:53.630196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:53.631579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.721726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 343/684] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:53.726320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.762673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aae1c-a0dd-456e-a27c-eb7a37740efa None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.763251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.835197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.836084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.836523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.836965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.837930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=634e36d89a344c1a87946891dbdbbfa2) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.838462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.840033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.863129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 342/685] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/role_assignments?user.id=634e36d89a344c1a87946891dbdbbfa2&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.874483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e273f-faa6-4e05-a730-abdebb7a71ff None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.918326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.918950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.919231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.919503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.920253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.920559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.922019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.942070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 344/686] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.947594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.034392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.078865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.110053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26352850-ba17-484f-a1ab-a1afd1a458cb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.130294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.155053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ae756-6e74-4969-8ab2-c4952173a37d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.155515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.156125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.156556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.156845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.197464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.198128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.198420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.198701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.211273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.213245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:54.229690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.230659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:54.231556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:54.231556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.231556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:54.231556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:54.237713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.245697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.247208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.354098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.354294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc10bf-874c-4285-8c87-1abc0b39d8de None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.382241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 343/688] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:54.388011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.398309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.415217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.416368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.416669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.416935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.417576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.417876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.420426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.444354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 346/689] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.451241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.566753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510aa16-66f6-4db2-a9ed-92d82ad26102 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.609529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.610602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.611091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.611661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.625584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.627408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:54.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.647100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:54.647982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:54.647982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.647982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:54.651365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 344/690] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:54.658294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.688198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bb902-fff3-402b-9444-c91e23b7001c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.703798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.756018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.756622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.756900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.757171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.757828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.759263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.809791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994afa-4643-4e1d-bc1a-7692c6c9b449 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.844370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.844978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.845258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.845532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.846195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.846492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.847873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.856954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 347/691] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:54 2022] POST /identity/v3/users => generated 254 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:54.866926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 345/692] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.872164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.937161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.002898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd83038-da83-4147-81ad-72c9497b8bc8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.039311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.039937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.040213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.040485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.048105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.049548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:55.061474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:55.062567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:55.063851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 348/693] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:55.068744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.183339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.201579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651439bf-51d5-4f68-8547-d36e0061aa1b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.243577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.244232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.244508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.244777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.245488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.245787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.247264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f4bb-6e34-47ac-96c3-f4e6aaa6a1b5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.267775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 346/694] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.273856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.400910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8058-6fed-4e1c-a4cd-85ad500c4f64 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.402731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.461979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.462402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.462648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.463531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.464265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=eced38ac42be41fa8aa9be12ca4ebde3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.464567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.466015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900d7b3-ebdf-472b-b88f-8bf9538698b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.472556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 349/695] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/role_assignments?user.id=eced38ac42be41fa8aa9be12ca4ebde3&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.723781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ab77-3a26-4692-8c5e-a557e481e756 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.724723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ab77-3a26-4692-8c5e-a557e481e756 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.725215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ab77-3a26-4692-8c5e-a557e481e756 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.726820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 347/696] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:55.734945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659890-284b-4928-ad72-291e23edd048 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.735232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659890-284b-4928-ad72-291e23edd048 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.735510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659890-284b-4928-ad72-291e23edd048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.744233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ff66-fa59-4e2d-b512-5dcc735b812b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.744532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ff66-fa59-4e2d-b512-5dcc735b812b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.744842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ff66-fa59-4e2d-b512-5dcc735b812b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.746509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 348/697] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:55.751783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.752074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.752353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.766432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a4659890-284b-4928-ad72-291e23edd048 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.773373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a4659890-284b-4928-ad72-291e23edd048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.786407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.788073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.879328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 349/698] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:55.911548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 350/699] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:56.222473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.315474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659890-284b-4928-ad72-291e23edd048 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.319079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.361926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76810b9c-5350-4e2a-bddf-4ce6312dc310 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.441341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.443370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.444071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.445654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] PATH_INFO: `/v3/services/network` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.446120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.447096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.449373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.456020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659890-284b-4928-ad72-291e23edd048 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.472113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.473268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:56.474220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:56.479712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 350/700] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.486416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.538701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.540529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.542340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.542631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.553424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d60ba3e0-6922-4ea5-8f23-ce162527429d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:56.558191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.559141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:56.559990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 351/701] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.561192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a399e-7b91-4696-8c99-3b3c7d7a1b0f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.561297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a399e-7b91-4696-8c99-3b3c7d7a1b0f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.561552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a399e-7b91-4696-8c99-3b3c7d7a1b0f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.566938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 352/702] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:56.567718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a399e-7b91-4696-8c99-3b3c7d7a1b0f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.627545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3480c-8276-429e-8f84-ba4745223346 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.663303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.664256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.664779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.665280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.666690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] RBAC: Adding query filter params (name=network) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.667218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.672634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db36a8d-db02-4ee0-a1c2-13866cc2d652 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.676470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a399e-7b91-4696-8c99-3b3c7d7a1b0f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.680513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 351/703] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:56.685421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.685421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.685645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.702426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.707947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:56.709144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:56.729179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.730032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.730479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.731352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.732338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.732909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.734951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.747645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 353/704] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.750563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.778301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.788210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 352/705] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:56.793159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.870002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5a1e-b2eb-479b-a4ae-474e9acaf5c3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.904335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.904951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.905235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.905497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.906292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.906606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.907966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.914280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 354/706] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.992417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908342-e546-4f5c-8eb5-89e74da3229c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.046762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.047831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.048357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.048851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.056491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.063882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.065352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:57.080801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:57.081757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:57.084022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:57.084022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.084022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:57.085928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 353/707] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:57.094609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.165733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.193850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.214498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1b074-9e45-4d4e-bf6f-39ef52ea9df8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.255323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.256782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.257252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.258063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.259104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.259686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.261588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e216179-7445-4842-8422-81a1b8f5008d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.280698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 355/708] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.282256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2454-cbab-48f7-b795-26f7fd414dcb None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.282550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2454-cbab-48f7-b795-26f7fd414dcb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.282832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2454-cbab-48f7-b795-26f7fd414dcb None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.284252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 356/709] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:57.284823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd2454-cbab-48f7-b795-26f7fd414dcb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.345611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5deb83-d1bf-4512-be38-3f32fa5f8136 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.383577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.384979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.385498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.386020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.386872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.388481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3f02d0ed-9418-4dd8-a22f-d0039c6a5900 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:57.398691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:57.399696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:57.401059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:57.404040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 354/710] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:57.405547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.406109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.406893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.425225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd2454-cbab-48f7-b795-26f7fd414dcb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.427913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:57.429412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:57.476331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.477222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.477681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.478212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.486325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.493687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.496320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.509057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 355/711] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:57.510298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:57.521662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:57.522692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:57.523618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 357/712] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:57.529171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.536057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.635656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5098-89d6-4745-a123-6d6f23c2d2d6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.682128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.682742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.683021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.683294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.683928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.684227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.685590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.696943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 356/713] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.702962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.764223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52951e-ad07-4c2e-98b9-076cb968622e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.780298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.812241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.813207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.813715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.814226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.815162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.816026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.817835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ab980-f1fe-44a9-bbab-b281e0fd3768 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.837753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 358/714] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:57.840088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb676ac-7e90-4b8d-8953-94b0d058f5ce None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.840573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb676ac-7e90-4b8d-8953-94b0d058f5ce None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.841313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb676ac-7e90-4b8d-8953-94b0d058f5ce None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.843259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 359/715] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:57.844230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb676ac-7e90-4b8d-8953-94b0d058f5ce None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.846148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d84054-0820-4fa3-9947-1bd484fb0ed2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.889629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.890658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.890943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.891370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.892113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.892428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.894540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c90d-306e-46d7-818e-22327dfa1348 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.907678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 357/716] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.907678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.907678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.907678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.914254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.936549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:57.938691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:57.984872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb676ac-7e90-4b8d-8953-94b0d058f5ce None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.032988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 358/717] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:58.035018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.035729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.036464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.036863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.037234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.106807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.131153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.133002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.176272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285161a4-7aef-48f9-8de0-4984e06573b1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.209462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.248043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.248873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.249281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.249661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.280796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:58.289197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.290217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:58.291562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.296681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.339159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 360/719] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:58.341828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.451143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.454278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25362b29-8382-45bb-9c4b-7f4be86b408c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.530197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.531351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.532005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.532385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.533167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.533612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.534357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b0332-b6d2-45b5-8499-99a2a2f1cbb7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.535237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.552980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 360/720] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.552980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.581972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.582411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.582646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.582923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.594865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.596333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:58.614042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.615453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:58.616385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:58.616385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:58.616385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:58.616385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 361/721] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.616385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.639890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.694036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e595-2301-476b-a1d2-d2e13dae47cc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.732098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4c0-32d1-498e-988e-e746e932670e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.735600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.736545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.737027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.737547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.749963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:58.755701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.756619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:58.757460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:58.764856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 361/722] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.766251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.768547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.769178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.769458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.769733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.781407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.782751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.797388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:58.798078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.799728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:58.800675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:58.800675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:58.800675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:58.804474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 362/723] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.805245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.883886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd41df-e403-407b-bece-f794b6cb5076 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.898377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.911405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fbfef-39d1-4484-82b3-7b6770628ebc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.922547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.923490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.923967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.924461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.925334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.925835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.927490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.939906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 362/724] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.941087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.952020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.952633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.952916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.953183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.953855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.954198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.955566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.969233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 363/725] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.969233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.037337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.057114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb9071-9e03-4fc9-add1-37960124a7c0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.072331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb2bc4-9b91-4c2e-8296-3c8ea7b19c4c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.096451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.097508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.098061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.098639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.099625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.100153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.101896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.102453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.113356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.118970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.118970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.118970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.119214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 363/726] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.119214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.125411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.128350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:59.141723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:59.142909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:59.143982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:59.145612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 364/727] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:59.146765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.258854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c62799-67eb-4c28-a6b0-f2d76f431b09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.295589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.296212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.296484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.296763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.304147 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.305579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-41536fb0-c2d8-4e4a-9332-8581f5b6903e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:59.318116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:59.319027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:26:59.319940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 365/728] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:59.320516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1365-bbd0-4785-b63f-3112ea5f82ac None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.320936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1365-bbd0-4785-b63f-3112ea5f82ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.320936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1365-bbd0-4785-b63f-3112ea5f82ac None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.326218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 366/729] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:26:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:59.327107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1365-bbd0-4785-b63f-3112ea5f82ac None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.350194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d994-595a-4557-88b9-f1b242823539 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.378120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.388055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.388677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.388953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.393741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.399507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.400973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.402748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:59.415769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:59.421324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:59.422218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:59.422218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:59.422218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:26:59.422218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 364/730] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:59.422218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.447907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1365-bbd0-4785-b63f-3112ea5f82ac None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.489155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.489763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.490081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.490356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.491104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.491410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.492849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d90db-acdf-49e6-9f16-9ba194ea6a76 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.506293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 367/731] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.507296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.507583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.507861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.526281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:59.527472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:59.536236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de342d6-d3e5-4cca-9a05-d0ecbbc8f21d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.579985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.580504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.580778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.581054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.581787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.582125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.583588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.605962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 368/732] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:59.605962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.615752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 365/733] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.616696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.652602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.674453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.725666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c5f9-e3eb-4a60-b6f8-793960d4d589 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.736353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bff9e-1177-41c0-8415-a5799c9972a7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.764225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.764928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.765289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.765645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.766612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.767003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.768644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.779576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 366/734] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.779576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.792115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.793241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.793698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.794391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.795706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.796157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.798258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.826150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 369/735] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.832673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.944112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c3133-2820-4d02-8b04-9229473ca4b2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.977816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.990425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.995958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac8af-b07c-4f62-a935-981b793f25c4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.998264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.998908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.999181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.999450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.031520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.032146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.032425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.032695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.040310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.041779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:00.053717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.054831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:00.055938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 370/736] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:00.056533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.084059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.085842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac3b33-1208-4220-8835-c059f6596a94 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.165274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef756a-e760-4d3e-bb8f-aa69190c58c0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 367/737] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b97f-f370-48c2-8265-99f480caf521 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b97f-f370-48c2-8265-99f480caf521 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1b97f-f370-48c2-8265-99f480caf521 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 368/738] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:00.192331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1b97f-f370-48c2-8265-99f480caf521 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.207487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.208094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.208376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.208653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.209302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.210704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.211670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.303194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 371/739] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/services => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:00.304369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.325430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1b97f-f370-48c2-8265-99f480caf521 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.330856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.366382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.367383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.367885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.368361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.369968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:00.370534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.372455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbbf-db57-49cf-b78a-48f6bd2a9ee6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.393692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:00.402774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.402774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.402774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.416031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:00.417626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.439094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919e6f-6991-405b-9ba2-aae8438b675c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.481339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.482078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.482361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.482638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.496395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.496842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.497835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.504728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 370/741] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:00.504728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:00.516365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.517486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:00.518398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:00.518398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:00.518398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:00.518398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 372/742] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:00.524179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.605949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.629974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5b97d-9510-41a9-beb4-34b11fdc9d05 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.642559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cd863-d857-4245-b6f7-30430016e4bc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.668182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.669163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.669679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.670196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.697967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.697967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.697967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.697967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.698582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:00.698894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.701257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.734203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 373/743] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:00.747502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.827906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.831631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.833343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.875937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d06ef-16e8-45da-8d5e-69ba02bfc343 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.912787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.923856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.925017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.925470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.926084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.935275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.937683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.948205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 371/744] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:00.948205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:00.958302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.959424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:00.960358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:00.963803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 374/745] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:00.964908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.062881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.066776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc361-4502-49f5-b858-718ecfc4cbf1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.095181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7879-e296-45b0-9066-bc040e1d7b28 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.103989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.104823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.105211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.105594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.106410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.107982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.135957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.136594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.136876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.137153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.148298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.149739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:01.165398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.166358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:01.167300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:01.167300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.167300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:01.167926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 375/746] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.168953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.212289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 372/747] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:01.213169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.223897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.348018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecb730-8b64-4368-8088-762d24027b09 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.350099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e80a-54a2-40e3-a1ca-2ab2b226f66e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.394042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.395211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.396021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.396626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.397570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.398166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.399904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.402175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.403186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.403186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.403380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.404161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.404540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.406096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.414124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 373/748] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.423087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.428770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 376/749] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.436018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.451033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.554445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5c5f2-6322-48da-9e7a-8441d6e814ab None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.559844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.563304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06076-f254-4373-b80f-f7288ab2ed29 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.598296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.598936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.599231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.599493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.603680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.604578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.605075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.605544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.606507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=64b7cf06c51045c1ab2ae0797f8dd08c) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.606789 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.607262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.608246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.609087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:01.620861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.621811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:01.622730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:01.625505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 374/750] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.628120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.628618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 377/751] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/role_assignments?user.id=64b7cf06c51045c1ab2ae0797f8dd08c&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.732074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.770145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a705dc-2575-4fed-9c00-4d3f7f0a338e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.817679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.818322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.818599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.818873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.819579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.819883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.821319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a274e-37cd-487d-8f05-5ed905b6ef6b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.835040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 375/752] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.841075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.918033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc03eef-7a34-4695-b68a-7cdbd0a924f4 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.918409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc03eef-7a34-4695-b68a-7cdbd0a924f4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.918589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc03eef-7a34-4695-b68a-7cdbd0a924f4 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.920167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 376/753] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:01.931311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.931599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.931860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.967052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:01.970085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:02.054252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 377/754] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:02.060020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f501ea-a000-4331-8ffb-6e9f9980b254 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.126648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.127265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.127547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.127821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.128553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=eced38ac42be41fa8aa9be12ca4ebde3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.128857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.130301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.136915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 378/755] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/role_assignments?user.id=eced38ac42be41fa8aa9be12ca4ebde3&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.376299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.445416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.481247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f33e-1882-4bc6-8782-5e7326584964 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.516488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.517400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.517669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.529047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:02.534203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.535117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:02.536338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 378/756] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.541343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.579609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.685383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c215d1-2164-4f7c-9047-b99b446f4437 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.733907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.734824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.735106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.735376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.736034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.736334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.737691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.747641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 379/757] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.755017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.884320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710fa5-ac02-4b2d-9501-a9879cfa6e1c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.910841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.919601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.920234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.920510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.920786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.931814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.933881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1faa66c2-3ff7-4c01-9c6f-fa152d118072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:02.948973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.949971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:02.951472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:02.951472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.951472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:02.951472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 379/758] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.956052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.004741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84dac8-544e-433b-9438-938ba4ff93f6 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.005251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84dac8-544e-433b-9438-938ba4ff93f6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.005251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84dac8-544e-433b-9438-938ba4ff93f6 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.006692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 380/759] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:03.012384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.012884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.013364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.041145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:03.045690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:03.127780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.148227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1514cae-1b94-4209-a7ae-6046facfaa2d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.155647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 381/760] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:03.206140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.206668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.206945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.207217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.207854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.208149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.209508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.226906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 380/761] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.232333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.344190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d6386-e6d8-4c2b-bcb9-9ebea28524d4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.353998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.379857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.380494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.380771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.381041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.388504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.389971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:03.402513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.403433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:03.404345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:03.406978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 382/762] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.412573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.532400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48223b-79fc-400b-86d7-b4429abc4b14 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.553912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.598697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.599314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.599595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.599870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.600617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.600920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.602388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.633526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 381/763] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.641358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.663432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.722522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a497-38d2-4f66-b48e-10c12f30a7a1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.764429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.765048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.765321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.765585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] PATH_INFO: `/v3/services/network` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.766186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.768066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a5cfe5b1-375d-4bbc-b5f6-39eaab327939 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.780598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.781622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:03.782951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 383/764] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:03.783752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8093d-81d7-4b9e-a614-27a1f8bd4e81 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.783752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8093d-81d7-4b9e-a614-27a1f8bd4e81 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.783752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8093d-81d7-4b9e-a614-27a1f8bd4e81 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.783937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 384/765] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:03.785998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8093d-81d7-4b9e-a614-27a1f8bd4e81 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.803282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd285ca5-9c54-4e2a-8da7-6e929aca0627 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.825213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.842239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.843078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.843560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.843970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.855433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.857906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-30194026-e214-4b71-b3a9-e34e05d606d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:03.877664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.878656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:03.879522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:03.879522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.879522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:03.881552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 382/766] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.882969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.883454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.883922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.901979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:03.903533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:03.911386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8093d-81d7-4b9e-a614-27a1f8bd4e81 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.959725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.960680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.961154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.961640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.962699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] RBAC: Adding query filter params (name=network) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.963228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.964823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.974499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 385/767] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.975443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.976526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.993986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 383/768] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:03.993986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.113892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.119733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f88fc-49d1-43fb-96ba-9cec2855170d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.119945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8147c9-2d62-4702-919a-52d69f1ef7f8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.158247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.158846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.159125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.159397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.160038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.160339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.161705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.167080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.167681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.167957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.168280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.169509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.169814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.172021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14412cf-8f34-4789-b858-6a3d14f59c4f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.177313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 384/769] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.178507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 386/770] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.178621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77f5e7-3970-4951-90e6-c872d30fbbef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.178783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77f5e7-3970-4951-90e6-c872d30fbbef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.179050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77f5e7-3970-4951-90e6-c872d30fbbef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.179448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.180470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 385/771] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:04.183195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77f5e7-3970-4951-90e6-c872d30fbbef None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.253750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.296670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4e6-b2bb-4632-9895-331fd9faaf8f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.312708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77f5e7-3970-4951-90e6-c872d30fbbef None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.331294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.331914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.332185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.332456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.340004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.341506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.349472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.350105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.350387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.350665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.351359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] RBAC: Adding query filter params (interface=public, service_id=fbb4a318324148d4999ea181485750a9, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.351661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.353004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e061c6cf-922c-4b57-9f1c-f9b0f73a2f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:04.353096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:04.353888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:04.354854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 387/772] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:04.355862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.355862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.356112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.371595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 386/773] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/endpoints?service_id=fbb4a318324148d4999ea181485750a9&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:04.372393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.375099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.376286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.389462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.444739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 388/774] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:04.445582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.475454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53510698-733d-4ffc-a647-55a6db47ef9d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.493253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.510996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.511627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.511969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.512244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.512850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.514283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:04.525730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:04.526967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:04.528612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:04.530363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 387/775] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:04.531787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.554785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e48f-893b-415a-b5b7-f548df786da6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.592394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.592993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.593272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.593545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.594262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.594576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.595990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f180f3-44a1-4d3c-8d4a-e2cf53221a22 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.608934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 389/776] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.612121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23529bc-7dbc-4cd4-826b-c1b05fa246b0 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.612767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23529bc-7dbc-4cd4-826b-c1b05fa246b0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.613643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23529bc-7dbc-4cd4-826b-c1b05fa246b0 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.615389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 390/777] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:04.616811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23529bc-7dbc-4cd4-826b-c1b05fa246b0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.629649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.636206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9e60d-cb8f-4f63-9fef-fb269d1a5f0e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.676839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.677479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.677981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.678216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.678823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.680217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.693988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 388/778] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.693988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.752616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23529bc-7dbc-4cd4-826b-c1b05fa246b0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.756093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.793298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.793913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.794222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.794494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.795132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.795432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.796810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5865a-7d3a-4abc-8b11-7041164bca67 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.802175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 391/779] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.803426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.803704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.803971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.822309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a733-db3e-4986-884e-83af4fb0a0ee None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.823906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.825106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.866830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.867747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.868029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.868306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.870996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=39cdc5dd5bdc44379c4504de359775c6, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.872522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.899491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.903950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 392/780] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:04.904838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.941807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 389/781] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:04 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:04.943197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.033553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051c235-f236-41ef-9a14-d3b93ff69861 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.094503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e30dec-a6a4-4a52-8101-0a4e7964f29d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.102078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.102977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.105375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.105790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.112584 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.131899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:05.138682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.139841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:05.140863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:05.150944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.156166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.176181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.176946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.178725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.179161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.180287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.180749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.183239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.189731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 390/783] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.199940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.245106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.298454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a3b-16d5-467e-af50-0fe4ba607aec None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.324154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a38b7c-3974-4004-8b3a-b6065ad4decc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.335983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.336992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.337444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.338007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.339004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.339502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.341115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.350626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 394/784] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.356970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.360677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.361297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.361587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.361855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.362968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] RBAC: Adding query filter params (interface=public, service_id=d886c0f3b918407e9d84069c62de65a1, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.362968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.364701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.371006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 391/785] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/endpoints?service_id=d886c0f3b918407e9d84069c62de65a1&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:05.372260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.408745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.469261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837b514-efb5-4641-a228-5fab559169ea None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.478101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086996f-3a67-4e91-974a-cbed46de2640 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.493367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.506415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.507284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.507735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.508285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.514627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.515401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.515761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.516108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.520766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:05.525553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.527170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:05.528129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:05.528741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.529779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.531877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 395/786] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.532835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:05.551436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.552438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:05.553306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:05.553306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:05.553306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:05.557759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 392/787] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:05.558661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.664999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3e78-ed6e-4f24-9ab6-bf16d36e9d5a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.702927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.704451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.704937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.705385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.706195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.707748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.713682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 396/788] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.714891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.773232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.788910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.814416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed07c4-1995-4095-95db-c644fa31ab42 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.836440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430fd7-816d-4348-b96f-3a914c65e271 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.874226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.874840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.875123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.875397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.876176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.876484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.877998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.891013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 393/789] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.893464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.894284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.894950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.895231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.895500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.896254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.896556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.898200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.913643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 397/790] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.920054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.026262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ac7a2-1061-48b5-a7c6-e01d0bb125f0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.063607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b966016-b18d-4056-bdfe-e58620c0b35f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.064546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.065518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.066030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.066530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.078051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.079877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.080506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.089419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:06.096593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.097987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:06.098870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:06.098870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.098870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:06.100955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 394/791] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:06.107319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.124577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.125220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.125499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.125772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.137275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.138759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:06.157808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.158834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:06.159767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:06.168016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 398/792] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.173802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.224331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9711f-628b-489e-acd7-96e7e95d1eb6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.264094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.265145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.265632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.266152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.267124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.267647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.269291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.283318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 395/793] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.289258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.355134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.385777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504f94-949c-4870-9687-951423c0e4bd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.400672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46cd4a-938e-401e-a902-b5f78b81cc5d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.438529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.439540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.440098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.440587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.449043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.453920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.457885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.458533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.458818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.459092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.459834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.460142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.461617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:06.465262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.466242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:06.467180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:06.469761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 396/794] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:06.475657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.501712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 399/795] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:06.506953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.554246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.585689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad10c4-7dce-4ada-be8e-d7ae735aca34 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.609077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.640743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.641367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.641656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.641931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.642692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.642996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.644433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.690035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ccef-a2b0-4673-8d5c-acd0c1197e9c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.692216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 397/796] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:06.697686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.764337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.765012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.765328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.765608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.788234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.789706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:06.815812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.816836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:06.817917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:06.817917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.817917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:06.817917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 400/797] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:06.824007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.871513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59203-0d53-49be-aec2-3a605ea4b876 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.906874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.918205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.919338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.919634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.919908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.931371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a7299-9e85-4d05-af23-402da42ec1cd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.933342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.935952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-83382c31-d9d9-4de2-98fb-95e0317f4490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:06.955656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.956882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:06.957773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:06.957773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:06.957773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:06.958430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 398/798] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:06.959562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313668b-f654-4020-aecc-98224ba1c966 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.959908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313668b-f654-4020-aecc-98224ba1c966 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.960249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313668b-f654-4020-aecc-98224ba1c966 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.965696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 399/799] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:06.966578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313668b-f654-4020-aecc-98224ba1c966 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.972373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.972979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.973261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.973535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.974226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.974531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.975906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac8ef-5867-4326-9b42-d480760bb244 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.990630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 401/800] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:06.992011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.992299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.992573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.000999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.011664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:07.012910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:07.097963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 402/801] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:07.097963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.114623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313668b-f654-4020-aecc-98224ba1c966 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.180017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.180685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.180972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.181251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.181906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.182232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.183701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.206508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 400/802] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.210443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.210888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.271766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f536c4e-b44d-4fe4-8742-0938965664bf None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.314377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.315014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.315296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.315573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.323953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.325576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.335548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4d549bb3-f1b6-4d1b-b717-10b8c704e59c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:07.337770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.338908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:07.340026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:07.345758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 403/803] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.353111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8013-9056-471e-864a-3153f228f1c0 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.353111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8013-9056-471e-864a-3153f228f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.353111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b8013-9056-471e-864a-3153f228f1c0 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.353344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df955de9-ec31-4a90-a156-3f99ad279f8e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.353420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 404/804] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:07.353997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8013-9056-471e-864a-3153f228f1c0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.390815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.391765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.392226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.392776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.400625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.402368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-10e34033-182b-4010-8036-82bdc88d6d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:07.419066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.427009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 401/805] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.428944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.429539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.448479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:07.449703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:07.469139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b8013-9056-471e-864a-3153f228f1c0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.499431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.510212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.513459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.513459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.513459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.513459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.513459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.515101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.521063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 402/806] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:07.526896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.527737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 405/807] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.528570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.618534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.640439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da768-e40d-43d0-8ff4-8f00febb86ba None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.663363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ed36f-1ff1-4524-9d0e-e3ba40120b55 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.684369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.685032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.685314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.685587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.686572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.686879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.690097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.704215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 403/808] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.705246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.717982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.718824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.719107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.719440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] PATH_INFO: `/v3/services/network` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.720014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.722502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.735831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.736885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:07.737726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 406/809] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.739347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.809818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.830439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce51cd-2586-4744-b941-9a7f8aa6a2a1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.865480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ac7a-c4cc-4606-836f-55b81726b620 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.867388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.868046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.868325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.868600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/64b7cf06c51045c1ab2ae0797f8dd08c/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.879608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.883728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=64b7cf06c51045c1ab2ae0797f8dd08c, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.885648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.904092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.904752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.905020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.905288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/eced38ac42be41fa8aa9be12ca4ebde3/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.907221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=eced38ac42be41fa8aa9be12ca4ebde3, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.908672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.937240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 404/810] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:07 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/64b7cf06c51045c1ab2ae0797f8dd08c/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:07.938117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.962258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 407/811] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:07 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/eced38ac42be41fa8aa9be12ca4ebde3/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:07.964265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.126509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f93b-e806-4203-b6d5-97cefc1203e5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.155526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cd98f-b5cf-4a49-91d4-95b6b0b84ad4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.168958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.178048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.178665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.178948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.179352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.179936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.180284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.181733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb17a9f-78dc-4c1b-bff1-39cb413d34e8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.190981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 405/812] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.193151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847fe1-f557-4b06-b61b-f4a5c266ab4a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.193644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847fe1-f557-4b06-b61b-f4a5c266ab4a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.194162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67847fe1-f557-4b06-b61b-f4a5c266ab4a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.196328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 406/813] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:08.196671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.197399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.197656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67847fe1-f557-4b06-b61b-f4a5c266ab4a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.197762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.202684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.216667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d2f64134-14a7-450d-bc35-c59c78ecbc38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:08.222613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.223513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:08.224344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 408/814] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.225536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf689-0986-4059-97a1-0f9271204401 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.225536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf689-0986-4059-97a1-0f9271204401 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.225794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf689-0986-4059-97a1-0f9271204401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.248023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-368cf689-0986-4059-97a1-0f9271204401 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:08.249387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-368cf689-0986-4059-97a1-0f9271204401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:08.273588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.324069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67847fe1-f557-4b06-b61b-f4a5c266ab4a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.347399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 409/815] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:08.347399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf689-0986-4059-97a1-0f9271204401 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.405535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.406516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.407009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.407513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.408436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] RBAC: Adding query filter params (type=network) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.408944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.410962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.425158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 407/816] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.430429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.455084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.458896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf689-0986-4059-97a1-0f9271204401 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.502777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.503440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.503894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.504178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.505227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.505537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.507285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.516167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 410/817] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.523101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.620081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cabcc9-d129-4d3f-8a4f-0603e7bd3686 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.666337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.693162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeb1d4-9d2f-4dd8-a80b-e9bb2f5cc7de None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.697906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.698579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.698858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.699132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.699806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.701168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.738898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.739535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.739816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.740094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.752184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.753672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:08.769411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.770478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:08.771818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:08.771818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.771818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:08.771818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 411/818] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.774048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.794732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.822106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 408/819] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:08.823062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.901025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d36ba-e287-42b3-87f5-5ff85f55b9c0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.954825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.955871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.956350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.958244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.959179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.960808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.982619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.983689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:08.984526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:08.992231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 412/820] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.998323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.065015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d3afc-260e-4266-858d-e8bce3fb68b1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.102303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.110696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.111611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.112081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.112513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.113348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.114102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.120671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.120792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bbe3f-90fe-458f-8acc-cfd0e2467520 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.133725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 409/821] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.135143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.157860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.158646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.158933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.159219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.159884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.160258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.161813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.167686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 413/822] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.173489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.175874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.250580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bcaa0-20ac-4cd5-aa7d-1f9849c00104 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.289243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58316f-3e01-4e8f-a7e3-6046d2211ddf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.291499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.292281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.292568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.292844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.301893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.303357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:09.317865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.318830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:09.319749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:09.324314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 410/823] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:09.325507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.334036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.334658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.335000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.335283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.335926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.336233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.338107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.345080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 414/824] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:09.350160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.362253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.442290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.458905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1e32-9c05-4ea3-9526-2d62fef1415a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.479895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48ccbd-c999-4dbe-8e80-a08149d3a076 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.496681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.497523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.497869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.498240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.499037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.499448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.501114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.520204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.521054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.521503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.521928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.522783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.524339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.525522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 411/825] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.526944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.599459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 415/826] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:09.642552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc6db-1e18-4f62-9e1e-160e14c0551c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.698415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.699048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.699331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.699652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.722078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.783500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.784946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66ba1-8e32-4982-ad94-7bc05c97be8e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.892020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 412/827] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:09.900611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.963069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.007664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b6335-095f-4f37-8ad1-6233b6e717c2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.013251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e876-3465-4e7a-b6fe-2bdda8bd477e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.013537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e876-3465-4e7a-b6fe-2bdda8bd477e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.013812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e876-3465-4e7a-b6fe-2bdda8bd477e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.015512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 413/828] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:10.027315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082191-6044-4216-93ba-4ac07399b605 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.027799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082191-6044-4216-93ba-4ac07399b605 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.028181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082191-6044-4216-93ba-4ac07399b605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.046671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.047392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.048249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.048519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.052911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-17082191-6044-4216-93ba-4ac07399b605 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:10.054224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17082191-6044-4216-93ba-4ac07399b605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:10.061341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.062833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:10.077464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.078420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:10.079502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:10.079502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:10.079502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:10.079502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 416/829] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.086044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.106633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.130376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 414/830] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:10.131630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329738-2436-4004-8012-4f34ed8a668e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.131920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329738-2436-4004-8012-4f34ed8a668e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.132196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329738-2436-4004-8012-4f34ed8a668e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.137843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 415/831] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:10.145518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.145518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.145518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.159967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:10.162714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:10.222500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b62422-0c55-419e-bcfb-165655ded7e4 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.236320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.258086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 416/832] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:10.270219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.271001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.271609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.272199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.273041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.273491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.275132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.288493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 417/833] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.296921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.400604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0eb3f-a397-4722-9475-91f2d4d4110b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.402647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.412196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.439537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.440463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.440956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.441404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.448377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.450160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:10.462244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.463264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.464374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:10.471078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 417/834] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.472407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.529901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d562b76-83ab-4461-a1c2-8036987ac6d7 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.575436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.575980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.576253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.576521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.577077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557d115-3521-4de0-9e1c-4c0507826927 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.586798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:10.591584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.592525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:10.593361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 418/835] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:10.594098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.619172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.619770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.620062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.621060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.621748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.622074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.623494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.628665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.641922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 418/836] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:10.641922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.674430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.710668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ccf36-5fc3-4e83-83b5-1be4e5e2f4f1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.749641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.750297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.750573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.750839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.756943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cc70-08f6-45bf-a0fd-8623197d63b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.761246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:10.766098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.767027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:10.767832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 419/837] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.768572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.799273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.799889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.800168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.800445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.801118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.801426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.802879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.812417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 419/838] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.817977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.871641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.882055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0852f-8e1d-4080-b956-1ce192d8b770 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.912520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.917749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.918596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.919059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.919559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.920450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.920769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.922217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.928233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030029c5-1fc2-4c09-860c-2b0d0afac326 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.938271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 420/839] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.938271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.985077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.985876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.986275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.986667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.987515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.987984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.989775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.000753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 420/840] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.006226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.085901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e520b33-9a1e-47b2-b9f3-17c0952a3ecc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.128639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.129201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.129482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.129759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.136422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5dc8-b7a5-42da-809a-b190608018a0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.149922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.152067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:11.168371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.169340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:11.170286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:11.170286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.170286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:11.170286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 421/841] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.175500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.180048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.181335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.181617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.181892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.184965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.194370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.201791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:11.213799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.215314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:11.216199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:11.216199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.216199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:11.216199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 421/842] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.221262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.225466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.312131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2b2de-7d3e-493a-bc7f-436c244a8dad None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.344000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e281a06-bf3a-493c-a9ce-4decc43abaf5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.350595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.351202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.351482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.351756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.352410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.352710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.354136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.372335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 422/843] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:11.373452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.390768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.391831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.392288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.392954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.394166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.394618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.396131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.414211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:11.420727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.452042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.502470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.505087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6b48-049f-4b7a-bb74-9f750b884b99 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.547793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77a15-02a7-4f0f-a072-cfb1c9cc75d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.554690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.555746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.556256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.556731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.565598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.567519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:11.579959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.580927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:11.581866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:11.587700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 423/845] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:11.588218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.590953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.591593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.591873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.592144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.601526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.604064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:11.621431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.622592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:11.623564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:11.626083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 423/846] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.629175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.717683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d5e34-cd3c-4147-8c51-c9243a23e957 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.745724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.746646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b6fb1-d14b-41ae-b7d7-be81a9eca4b0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.756365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.757652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.767921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.767921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.767921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.767921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.767921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b3850-17ff-4e21-a940-cb3e08f284d1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.771762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.781294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.782969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.783688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.784025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc39d0-6133-4316-84fd-9a6b8b482db9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.784499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.784768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc39d0-6133-4316-84fd-9a6b8b482db9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.785252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.785492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc39d0-6133-4316-84fd-9a6b8b482db9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.786746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.787056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.787681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 425/848] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:11.788512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc39d0-6133-4316-84fd-9a6b8b482db9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.788626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34752d8-3008-409a-97d8-eb5e6ff3783d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.812688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 424/849] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.814648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.814942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.815372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.838736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:11.839972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:11.904112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc39d0-6133-4316-84fd-9a6b8b482db9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.917973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:11.917973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.948071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.948793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.949136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.949410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.006257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.024313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.025986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.037634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f8b1c-fa55-4367-b9cb-980277ff3fc1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.051814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.075310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.076271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.076698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.077115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.146942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 426/851] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:12.157655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.173496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.175645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.240526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.256977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86bc0-24a5-462c-a483-aa7f53aad9ea None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.282582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 426/852] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:12.284008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.299265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.299517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.300374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.300512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.300983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.311603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.313045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:12.328699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.329658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:12.330568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:12.330568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.330568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:12.330568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 427/853] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.330790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.395017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47d746-42af-4f66-9f32-ad7b2e0cc5ed None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.437543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.438189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.438625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.438902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.439580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.440925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.445721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830592-7556-4f26-9f78-cda57f00b18b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.450215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.451178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:12.459871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 427/854] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.460698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.485225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.486059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.486405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.486756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.490086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.499346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.501131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:12.516151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.517123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:12.518541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:12.518541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:12.518541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:12.518541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 428/855] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.518541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.546244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.576141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f4b6f-9f03-4f38-a2ed-d573005d719a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.614441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.615356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.615635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.616161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.616860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.617314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.619070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.624511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189e4e0-17ca-49bd-b40a-32c42a7672fc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.632971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 428/856] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.634161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.664906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.665506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.665810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.666129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.666755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.667554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.668922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.683640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 429/857] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.684378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.744070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.754626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8917f-e39d-4004-9ba0-26f676f0853d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.792457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.793060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.793328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.793599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.794268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.794569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.794906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1575c6-a0ab-4d77-8723-179b739d4f1d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.795926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.799326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.808944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 429/858] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.809603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.839591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.840315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.840590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.840958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.848196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.849653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:12.867210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.868125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:12.868996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:12.872392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 430/859] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.873409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.950978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c8d9-38c6-4a24-aa00-bfa08a7db8dc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.998487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.999099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.999381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.999654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.000290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.000596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.002441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.010008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 430/860] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.010923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.029596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1de3c-06c5-41d3-8cad-d98e6af1b3fc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.051134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.081556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.083061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.083355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.083585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.085970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.095228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.096723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0218141a-8e5b-4f77-83f9-c34098400310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:13.120289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.121247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:13.122174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 431/861] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.123366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacfdb-bfde-4d1b-a4a7-1a705889ae6e None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.123366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacfdb-bfde-4d1b-a4a7-1a705889ae6e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.123551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bacfdb-bfde-4d1b-a4a7-1a705889ae6e None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.129416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 432/862] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:13.130401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bacfdb-bfde-4d1b-a4a7-1a705889ae6e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.140610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2dee9-b069-4acd-bf35-572af28ca65d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.197257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.198391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.198820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.199381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.200097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.200407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.202296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1387-4372-4efd-be7b-0370622e0673 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.223464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 431/863] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.224871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.225164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.225442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.244675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:13.245987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:13.257123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bacfdb-bfde-4d1b-a4a7-1a705889ae6e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.294119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.294810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.295190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.295569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.296365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.296674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.298144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.310250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 433/864] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.311076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.322592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 432/865] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:13.323468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.349259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.394937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.428032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28932550-9a1a-4385-b95f-d3588e91b1fa None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.468912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792733d-f7aa-490d-a46c-256837f2381b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.475126 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.476054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.477057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.477573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.479013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=64b7cf06c51045c1ab2ae0797f8dd08c) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.479556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.481980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.491222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 434/866] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/role_assignments?user.id=64b7cf06c51045c1ab2ae0797f8dd08c&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.510695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.511964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.512244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.512521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.513283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=eced38ac42be41fa8aa9be12ca4ebde3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.513595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.515267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.523276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 433/867] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/role_assignments?user.id=eced38ac42be41fa8aa9be12ca4ebde3&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.626008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.735062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.741539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4d8ae-e88b-4cf2-94c7-fa6b31bfe627 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.778807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.779440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.779722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.779994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.780586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.782053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.790826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.791747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:13.793041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 435/868] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.797772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.906945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611b98-1a31-48b5-a299-d2ecdd5cff02 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.921542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.943348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.943957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.944242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.944518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.945149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.945455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.946962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262abe-6fdd-4c32-a35b-5059847e4f20 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.952570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 434/869] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.959047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.072316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4bfb-41a7-4f69-aac6-5fcbea54e9af None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.110172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.110809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.111088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.111360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.112016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.112318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.113742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c6268-61a6-4854-82a6-5ea59842478f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.119886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 436/870] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.064806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662a6b-1f64-4c52-b6aa-d8f7a079cf2e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.065343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662a6b-1f64-4c52-b6aa-d8f7a079cf2e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.065661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43662a6b-1f64-4c52-b6aa-d8f7a079cf2e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.068401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 435/871] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:15.076906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca25ff-df84-43c5-b5da-9369ef1e7d96 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.077337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca25ff-df84-43c5-b5da-9369ef1e7d96 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.077516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca25ff-df84-43c5-b5da-9369ef1e7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.096613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b2ca25ff-df84-43c5-b5da-9369ef1e7d96 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:15.097795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b2ca25ff-df84-43c5-b5da-9369ef1e7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:15.115987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.179279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 437/872] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:15.451659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662a6b-1f64-4c52-b6aa-d8f7a079cf2e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.577092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43662a6b-1f64-4c52-b6aa-d8f7a079cf2e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.611085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.611692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.611968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.612238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.612896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.614543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff329b5-2d19-4588-a43f-999ddf35e476 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.615588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a362-1d36-40f1-89b3-c7eaed6d535a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.616095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a362-1d36-40f1-89b3-c7eaed6d535a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.616576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1a362-1d36-40f1-89b3-c7eaed6d535a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.618527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 438/873] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:15.624323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.624676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.625021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.644041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:15.645410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:15.664737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 436/874] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:15 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:15.666345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c962fd-6983-41ec-8124-63d516deb59f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.666826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c962fd-6983-41ec-8124-63d516deb59f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.667789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c962fd-6983-41ec-8124-63d516deb59f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.669292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 437/875] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:15.677538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.678131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.678617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.703593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:15.705839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:15.738701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 439/876] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:15.757074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.801395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 438/877] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:16.012788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.089919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.101024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.121148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd9479-1e8c-4f83-856a-2d6546b17434 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.156405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.157038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.157319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.157590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.158220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.159591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.169252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.170297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:16.171131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 440/878] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:16.183658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.204244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c299f-e1a1-4fad-9332-45cac11109d0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.248674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.249827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.250292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.250564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.261845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-4413b076-e3ba-44be-bf5c-10ecc10f95ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:16.267457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.273525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 439/879] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:16.274401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2399-d0bf-4581-bef2-2acef19a4aa0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.275165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2399-d0bf-4581-bef2-2acef19a4aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.275165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2399-d0bf-4581-bef2-2acef19a4aa0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.275165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 440/880] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:16.275165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2399-d0bf-4581-bef2-2acef19a4aa0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.305430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.315055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf56d-c4cc-47e3-830c-ac9d8ed9ae27 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.350669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.351373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.351726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.352074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.352772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.353076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.354483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf0931-9129-466e-8c88-4f49435735ac None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.359867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 441/881] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.361032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.361312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.361584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.380244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:16.381425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:16.383720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.392566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2399-d0bf-4581-bef2-2acef19a4aa0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.437469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.438102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.438541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.438818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.439811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.440377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.442385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.457710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 442/882] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:16.457710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.458009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 441/883] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:16.458009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.561981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb3ac1-d9db-475f-8307-cc732537697f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.579439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.593734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8321ed5-623b-4f20-8540-3288b3a7dbea None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.605386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.606022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.606299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.606567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.607369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.607699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.609062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.618365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 443/884] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.635654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.636895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.637177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.637449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.650616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.652707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:16.668969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.670025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:16.670923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:16.670923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:16.670923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:16.670923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 442/885] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:16.676561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.679656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.770033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.797123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db4628-fa7f-4a60-984b-e7de82818899 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.839108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.839699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.839976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.840447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.841915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.842168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.843908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.860579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 444/886] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.866407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.894339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f8334-c95e-4bc4-b34e-e6ec9a4f8882 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.940906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.941868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.942239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.942523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.943734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.945246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.946299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.986588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f1f95-5681-4086-874a-3d2bd000bf79 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.021903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.022825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.023106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.023422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.034772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.036209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:17.050908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:17.052072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:17.053154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 445/887] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:17.055505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.056318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 443/888] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:16 2022] POST /identity/v3/services => generated 269 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:17.174883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5b8b7-a013-4620-bda0-15b4332d1968 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.201188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.219508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.220112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.226985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.226985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.226985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.226985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.226985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.241892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 446/889] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:17.247895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.251775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.364897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04569ae7-67dc-4285-baf9-0f31723f313f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.401864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.402503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.402787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.403057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.476673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.478106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665136c-76ae-46e8-834d-7bff77c6cefe None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.479941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.586050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 444/890] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:17.591046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.693968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299ebf-d32b-47fa-875a-374fde5746a1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.693968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299ebf-d32b-47fa-875a-374fde5746a1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.694148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299ebf-d32b-47fa-875a-374fde5746a1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.695367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 445/891] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:17.701005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.701283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.701556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.704599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9011-8c1e-4655-b8cf-990f89eff9a6 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.719854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:17.721310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:17.747074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.747684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.747965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.748241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.760803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.763232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:17.782224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:17.783243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:17.784562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:17.784562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:17.784562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:17.784562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 447/892] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:17.790036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.813968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 446/893] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:17.827096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.901546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d8e31-f253-460e-ae54-b3d0f74aa72d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.937008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.937607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.937886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.938191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.938830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:17.939134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.940495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.952421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 448/894] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:17.957981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.990668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.062766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5a039-89b8-4c51-965e-bf5be6ea468f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.079735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.110964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.111990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.112413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.112959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.123097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.124731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:18.139303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.140412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:18.141488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:18.144293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 447/895] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:18.154047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.186766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.199668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2e790-6218-430a-b41a-ead506537655 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.237418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.238291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.238675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.239051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.239989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.241550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.250775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.251998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:18.253088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:18.255123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 449/896] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:18.260727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.282630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.295387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3e76f-a9fd-4cbc-a88f-8f23622c0572 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.342790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.344463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.344896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.345372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.346235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.346703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.348391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.365581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 448/897] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.371469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.376687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76f84c-db1c-4deb-bd6b-c9efe8e45d50 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.413727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.414444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.414786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.415122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.415812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.416211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.417778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 450/898] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.428903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.448231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.511751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c14a9-8156-4a5a-a2e0-64562ec6b729 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.545235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724317-1a5e-483c-be32-a993056a8db3 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.550824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.551483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.551760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.552079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.552803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] RBAC: Adding query filter params (role.id=052fab47d9bb4c6ba95f4e4e99caa23f, scope.project.id=f090099f7a4443abba863c4002872264, user.id=64b7cf06c51045c1ab2ae0797f8dd08c) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.553165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.554613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.561004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 449/899] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/role_assignments?user.id=64b7cf06c51045c1ab2ae0797f8dd08c&scope.project.id=f090099f7a4443abba863c4002872264&role.id=052fab47d9bb4c6ba95f4e4e99caa23f => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:18.588268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.588917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.589197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.590118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.590768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.591066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.592741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6827b-76b1-44a3-95c6-3e08d99e791a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.603740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 451/900] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.605694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.615873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12e407-4dad-42e2-a18f-5e0c7b3d4992 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.616224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12e407-4dad-42e2-a18f-5e0c7b3d4992 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.616425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12e407-4dad-42e2-a18f-5e0c7b3d4992 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.618168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 452/901] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:18.625221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.625535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.625773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.638489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.645714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:18.647040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:18.733563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 453/902] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:18.764865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebefc7-6e6f-44ea-9dab-9c00cf0be5f7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.801402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.802040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.802322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.802642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.803347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] RBAC: Adding query filter params (interface=public, service_id=c83c3471d373494a88c5d13dcd82fefb, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.803654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.805022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.811300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 450/903] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/endpoints?service_id=c83c3471d373494a88c5d13dcd82fefb&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.816723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.830060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.932778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ef945-bd4c-4833-b170-7c003a2fc866 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.971821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.972423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.972697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.972963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.973566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.975014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58a14c-8c6b-4b10-aa6a-251d2ccde4a7 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.986073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 454/904] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:19.012351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.111322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.132733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f679f5-d89e-425e-bfa8-6e24da935a6b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.168656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.169266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.169545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.169819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.170507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.171869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.175903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddff-c216-4a79-a822-73471e05080c None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.176192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddff-c216-4a79-a822-73471e05080c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.176480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddff-c216-4a79-a822-73471e05080c None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.177815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 455/905] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:19.183165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.184017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.184296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.202953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:19.204148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:19.251110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 451/906] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:19 2022] POST /identity/v3/services => generated 241 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:19.291268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.299488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 456/907] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:19.582899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.691243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97da7-ffe6-4413-8508-8e425927f300 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.731126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.731997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.732419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.732842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.733611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.735167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.744622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.746278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:19.747251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:19.749749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 452/908] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:19.755582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.863511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd21b3d-d53e-4642-9481-7581af7327a8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.900349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.900958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.901238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.901510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.902205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.902509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.903947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.909654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 457/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.915398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.930313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.021304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032c23-de0d-4e18-867d-935e12dd1a23 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.059133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.059741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.060018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.060289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.060923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.061223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.062608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.068112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 453/910] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.074022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.144689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.184111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdb398-6e73-4f88-a48e-51444a97afff None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.219641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.221054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.221541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.222063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.222968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] RBAC: Adding query filter params (interface=public, service_id=d655dc700c2e4ea6817d603000717878, region_id=RegionOne) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.223503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.225079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f3355-0d4f-4fa2-a043-416c649b6cbe None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.233481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 458/911] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/endpoints?service_id=d655dc700c2e4ea6817d603000717878&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.239442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.310642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.354734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52e9d-f70f-48a1-8311-30f783c90d7d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.391424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.392433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.393016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.393504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.394381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.396023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af5760-d37f-4432-a2ac-5e314b382cfa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.403057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 454/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:20.502145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee007ce-56a4-4a06-b606-bb12af65d82d None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.502476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee007ce-56a4-4a06-b606-bb12af65d82d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.502703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee007ce-56a4-4a06-b606-bb12af65d82d None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.504323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 459/913] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:20.509857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2daa-4a09-4b93-bcca-beefa4b31b9c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.510177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2daa-4a09-4b93-bcca-beefa4b31b9c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.510454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c2daa-4a09-4b93-bcca-beefa4b31b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.529878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6e3c2daa-4a09-4b93-bcca-beefa4b31b9c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:20.531146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e3c2daa-4a09-4b93-bcca-beefa4b31b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:20.605862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 455/914] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:20.876990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee007ce-56a4-4a06-b606-bb12af65d82d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.989044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee007ce-56a4-4a06-b606-bb12af65d82d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.013541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba255-9a14-4e62-92e6-23a656b83c42 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.014221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba255-9a14-4e62-92e6-23a656b83c42 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.014612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba255-9a14-4e62-92e6-23a656b83c42 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.020271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.020538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 456/915] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:21.022229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.022564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.023051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.028089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.028732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.029098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.029380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.040711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:21.043742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:21.045176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:21.046705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.047642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:21.048498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 460/916] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.054880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.114410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.127187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 457/917] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:21.180003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cae43c-8605-4c08-bec4-f0f0cf97e893 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.214525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.215643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.215929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.216201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.216862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.217164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.218563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23728a3-69e2-47ce-a698-23fb5bee019c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.227124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 461/918] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.233623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.343907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2009-84ef-469a-b5c3-9d8c475e7e29 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.380517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc601472-1dd5-47db-95af-32a61a86957e None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.380815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc601472-1dd5-47db-95af-32a61a86957e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.381077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc601472-1dd5-47db-95af-32a61a86957e None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.382760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 462/919] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:21.384266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.384899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.385177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.385448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.391048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.391618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.392609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.399895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.401326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.414089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:21.415421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:21.422734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.429159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:21.430078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:21.430078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:21.430078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.430078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 458/920] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.430078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.467622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.477490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.488581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 463/921] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:21.489862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.548697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab8268-3d24-405d-af6b-6423829bf67d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.588833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.590149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.590632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.591192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.591980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.593763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.603907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.604855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:21.606698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.607412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefe173-2f25-4dcb-b862-900454f2ad6b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.609418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 459/922] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.617981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.650735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.651354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.651642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.651920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.652868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.653181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.655471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.670572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 464/923] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.676117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.722192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.743663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b705147-9a25-4df2-a4e8-024caa00ea07 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.754060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.783292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.783982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db38ae-3d91-46c9-9944-c000f213556f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.784441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.784893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.785349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.786299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.787544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.789143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.796453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 460/924] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.797513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.825440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.826102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.826423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.826648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.834591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.835901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:21.847517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.848465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 465/925] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:21.849422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.910472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6fc40-abf5-4c08-b5bf-6c79e97be8b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.948322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.948952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.949285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.949536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.950149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.950304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.951877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.953317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda7925-0eb9-49d4-993f-5374dba47adf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.960990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.974079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:21.975050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 461/926] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:21.975967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.991758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.992403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.992683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.992959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.993644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.993967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.995376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.000383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 466/927] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.001160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.015573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.083758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c688-242d-4879-b403-e60ad035ea48 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.110656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37967c0d-d56d-4bb0-aa36-e54141d2979d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.118270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.118876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.119151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.119421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.120155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.120448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.121896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.139617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 462/928] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.144982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.149171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.149403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.149682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.149971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.150601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.150906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.152854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.158064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 467/929] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.158688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.188880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.247884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.254732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acef9-0180-4f69-a6e5-82262789b6e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.268206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e437-70c9-49df-bf83-6ceb23198790 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.292037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.292743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.293107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.293334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.294026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.295395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.305525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.306179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.306459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.306731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.317236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.318708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:22.334725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.335816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:22.336690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:22.336690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:22.336690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:22.336690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 468/930] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.336690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.374245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 463/931] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:22.375590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.445863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.467882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85974-c523-460c-b69e-d1ed5c225e53 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.498142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9bbff-aaf6-4173-ac17-33dcf9590ae5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.507697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.508478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.508759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.509032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.509681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.510132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.511557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c468-22b7-42e7-a8a0-9fff1c24b4c4 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.519692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 469/932] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.519692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6beec7-2d1e-4310-8244-2a2be9374b21 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.519692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6beec7-2d1e-4310-8244-2a2be9374b21 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.519692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6beec7-2d1e-4310-8244-2a2be9374b21 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.524650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 470/933] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:22.526747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.526747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.526747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.545377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.545377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.545657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.545928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.546486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.546785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.546879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:22.548034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:22.548203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.562848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 464/934] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.563700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.575452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.624201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 471/935] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:22.631130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.687172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea383357-cb03-4060-bf31-daf530138dfc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.733290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.734773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.735390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.735668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.735940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.736649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] RBAC: Adding query filter params (interface=public, service_id=c8f3c249249240d1966c0ae54f656fa5, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:22.736957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.738744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.751563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 465/936] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/endpoints?service_id=c8f3c249249240d1966c0ae54f656fa5&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:22.753485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.776074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce160b4-7bfc-4112-a494-1aa463e78934 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.818154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.818818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.819098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.819368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.829905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.831912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.843328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:22.846487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:22.847377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:22.848308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 472/937] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:22.857527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.883894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4ee5-18ed-49f0-8bad-c2cf247994eb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:22.921134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:22.922292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.922572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.922847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.923451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:22.924808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:22.931430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 466/938] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:22.934322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:22.982300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ce853-cb24-45e3-b921-abee98be53ce None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.023689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.024723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.024723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.025099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.025977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.026351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.027968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.030107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.049304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 473/939] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.050882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.079414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5939cc1-54a7-42a0-aaf8-65ecdedc82ce None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.132004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.132760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.133150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.133428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.134051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.135402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.139078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:23.157182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:23.158244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:23.159137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 467/940] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:23.165706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.184386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91a83e-12b4-4428-aeab-777f30b722d1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.221399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.222149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.222424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.222741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/64b7cf06c51045c1ab2ae0797f8dd08c/roles/052fab47d9bb4c6ba95f4e4e99caa23f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.224923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=64b7cf06c51045c1ab2ae0797f8dd08c, role_id=052fab47d9bb4c6ba95f4e4e99caa23f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.226394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.283618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cfdd9-af9b-46d5-8377-222313493f72 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.313472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 474/941] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:23 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/64b7cf06c51045c1ab2ae0797f8dd08c/roles/052fab47d9bb4c6ba95f4e4e99caa23f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:23.332370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.333392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.333996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.334496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.335353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.335974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.337605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.344083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 468/942] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.350313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.429960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.480086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d862f8-db41-4f40-af9d-12f81312ef75 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.521067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.522122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.522656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.523138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.523985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.524558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.526253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500797-d786-4f12-bbcc-0534a8f12259 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.532122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 475/943] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.538498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.604773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.645815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7963-84ad-448c-9ab8-7c30109aad0a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.685571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.686205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.686482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.686754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.687410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.688765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f68d26-f985-4630-ba03-cc0cddd999cb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.787408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 469/944] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:24.390209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633480-dbda-4b5d-a2a7-5b7c2bf479b9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.390724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633480-dbda-4b5d-a2a7-5b7c2bf479b9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.390800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca633480-dbda-4b5d-a2a7-5b7c2bf479b9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.392344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 476/945] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:24.397495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.397792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.398105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.420995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:24.422442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:24.503940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 470/946] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:24.783239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca633480-dbda-4b5d-a2a7-5b7c2bf479b9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.892044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca633480-dbda-4b5d-a2a7-5b7c2bf479b9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.911896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.930020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.930630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.930962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.931236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.931888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.933318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.936470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING keystone.server.flask.common [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:24.979597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.sql.core [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:24.979597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:24.979597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [parameters: {'id': '2ad7abcf99a8452b9625a091a3b6f1b5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:24.979597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81740) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-d306aa67-d891-46aa-9094-538a7b2bec50 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ad7abcf99a8452b9625a091a3b6f1b5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ad7abcf99a8452b9625a091a3b6f1b5. Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:24.997556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 03:27:24.998458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:24.999419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:25.000299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:25.001217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:25.002040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [parameters: {'id': '2ad7abcf99a8452b9625a091a3b6f1b5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.002920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.003725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2ad7abcf99a8452b9625a091a3b6f1b5. Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.007349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 477/947] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 24 03:27:24 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:25.011294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.022458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a77c-7bbc-47d3-af58-9d2fd5160f5b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.022767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a77c-7bbc-47d3-af58-9d2fd5160f5b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.023045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047a77c-7bbc-47d3-af58-9d2fd5160f5b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.031393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 478/948] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:25.032990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.033279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.033609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.053511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:25.055068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:25.063478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.125479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048a334-4be6-4394-8625-272035ee5f01 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.138025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 479/949] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:25.169560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.170689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.171175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.171650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.179276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.181027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9c9f1238-a563-46f9-b28f-1ee00b6517ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:25.193430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.194387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:25.195270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:25.197808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 471/950] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:25.208448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.304338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681674e2-a46c-4de6-85fd-5b5a466de193 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.304946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681674e2-a46c-4de6-85fd-5b5a466de193 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.305424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681674e2-a46c-4de6-85fd-5b5a466de193 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.306768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f6040-facc-4c25-9d01-10c504548f28 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.307542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 472/951] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:25.310237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.313083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.313346 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.313628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.333334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:25.334932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:25.342170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.342785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.343062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.343336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.344001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.344300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.345931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.364821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 480/952] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.408350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.417088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 473/953] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:25.526494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc7ba-6dc7-4437-b84e-0dff36dbe511 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.564430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.565035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.565362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.565657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.566272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.567626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.576858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.578029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.578935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 481/954] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:25.584199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.622507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.695891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.702900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3c4a-d04b-49eb-a6be-77b95325034e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.726739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.747694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.748899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.749806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.750469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.751391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.752097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.754083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.762165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 474/955] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.768404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.812540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51a66-da03-41f4-a543-dae84578b10c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.857391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.858513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.858513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.858692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.869757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-cc0221cd-0a99-4430-98ba-38dafcb61095 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:25.874575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.875526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 482/956] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:25.878999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ffd68-bc80-4f98-8e7f-130350e31166 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.879836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ffd68-bc80-4f98-8e7f-130350e31166 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.879836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ffd68-bc80-4f98-8e7f-130350e31166 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.883153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 483/957] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:25.883922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ffd68-bc80-4f98-8e7f-130350e31166 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.890443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.893889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e18e-c495-4657-9afa-858192ef908e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.929633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.930268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.930549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.930825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.931459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.931763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.933126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6b795-133b-4da7-83d9-36354909bae2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.939172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 475/958] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.940341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.940623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.941022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.959242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:25.960447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:25.995913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.010440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ffd68-bc80-4f98-8e7f-130350e31166 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.033420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 476/959] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:26.035377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.046285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.047011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.047393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.047741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.048482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.048857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.050322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.064185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 484/960] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:26.065505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.175174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.187433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a350f7f-01d6-40eb-b997-9d1d4f5c8f52 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.192403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eccd58-45c4-4688-950e-380500d48cdd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.227856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.228560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.228756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.229037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.235223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.236080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.236572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.237535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.238921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.241124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.241244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.242714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:26.257590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.258764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:26.259778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:26.259778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:26.259778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:26.262266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 485/961] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:26.268630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.268630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.322881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 477/962] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:26.322881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.395886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6413c8-772c-43c8-a967-8ac2c5ac26f8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.458395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.459030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.459317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.459595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.459707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40615-1d55-4bca-bb2b-ad0cc8feed74 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.460304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.460618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.463439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.483008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 486/963] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:26.491355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.508390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.509369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.509720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.510224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.511369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.512077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.525641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.527098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:26.529168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.533697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.549334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.570715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.627802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6abc4c-0536-4985-b85f-697fd90cb66e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.662613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d170-f48b-4722-bad6-2533bc26441c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.664899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.665535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.665815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.666141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.674168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.679023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:26.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.698098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:26.699083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:26.700213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 487/965] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.705585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.706214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.706494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.706765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.707394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.707693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.709095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.711116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.714583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 479/966] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:26.720291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.821502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.827251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34d1ba-2ffe-455a-ac27-906db6bca0f0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.846876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.862528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95e04b-8d58-49b1-97de-5c0c70414f73 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.867872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.868738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.869678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.870217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.871879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.872430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.874234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.898490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 488/967] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:26.900720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.903787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.904399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.904726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.905005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.905834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.906183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.908414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.918049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 480/968] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:27.025636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88730a7-e97b-4edd-8ed6-dc1642f5e71c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.071181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.071807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.072087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.072360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.122883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.147619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.149081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.258696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 489/969] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:27.265036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.369240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c079f2-fcb9-4f1e-8efc-26eb794cd516 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.405508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.406169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.406448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.406718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.409866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.418166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.420127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6b53ce18-f6c7-44e2-ba81-c95a255d8b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:27.435898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:27.437002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:27.437903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:27.437903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:27.437903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:27.437903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 481/970] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:27.444464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.469552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07632f-40f8-4399-a0ad-2af30ffae110 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.469910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07632f-40f8-4399-a0ad-2af30ffae110 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.470141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07632f-40f8-4399-a0ad-2af30ffae110 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.471755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 482/971] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:27.476789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.477078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.477366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.495910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:27.497702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:27.533734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.557448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb06a-dadb-43ad-93cc-dc9ee6499b8d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.593695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.594346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.594623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.594954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.595601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.596023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.597396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.602021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 483/972] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:27.613313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 490/973] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.623086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.730196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f103d-6f0e-46e7-9ff0-d395bf36be35 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.748414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.766033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.766661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.766939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.767210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.773967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.775395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:27.788860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:27.789768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:27.790696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 484/974] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:27.797880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.893338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.909176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ecfd-1351-4d06-8662-fdb055048ae5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.945999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.946616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.946895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.947168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.947870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.948176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.949645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.952997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.965985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 491/975] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.971021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.031489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556dd88-9748-4c63-a3c2-40771e9187af None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.087694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.088301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.088581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.088856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.089504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.091521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.094187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING keystone.server.flask.common [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:28.097312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526c6b-be9e-4d24-91f5-077bc5b7b0ba None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.136545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.137843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.138283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.138670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.139593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] RBAC: Adding query filter params (role.id=052fab47d9bb4c6ba95f4e4e99caa23f, scope.project.id=f090099f7a4443abba863c4002872264, user.id=64b7cf06c51045c1ab2ae0797f8dd08c) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.139800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.sql.core [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:28.139800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:28.139800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [parameters: {'user_id': 'bf72a8dad32e41fdb7c923209fb396b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:28.139800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81741) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:28.140154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.142593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:28.150040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:28.150953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:28.151990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:28.154122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:28.155732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:28.157255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf72a8dad32e41fdb7c923209fb396b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.158898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 03:27:28.160593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:28.164057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:28.164760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 492/976] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/role_assignments?user.id=64b7cf06c51045c1ab2ae0797f8dd08c&scope.project.id=f090099f7a4443abba863c4002872264&role.id=052fab47d9bb4c6ba95f4e4e99caa23f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:28.164894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 485/977] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 24 03:27:27 2022] POST /identity/v3/users => generated 160 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:28.170516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.238771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.288676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd18b1-e2cc-4510-8706-bf3f513324c0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.328197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.329139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.329628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.330127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.338481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.340840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-8dae7b80-f460-4d18-96e3-4a7274a9fb20 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:28.353460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:28.354474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:28.355424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:28.357681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 493/978] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:28.363423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.413632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.453140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad060-0e41-4682-9574-8a5667f2466f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.453576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad060-0e41-4682-9574-8a5667f2466f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.453861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad060-0e41-4682-9574-8a5667f2466f None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.455428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 494/979] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:28.461600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.463307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.464600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.482239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b1679-6f12-4c38-84a0-dcfead072908 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.486771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:28.488283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:28.521646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.522333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.522614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.523034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.523840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.524146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.525889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50677c-323a-4d1c-9b88-3a4a98a2459c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.567093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 495/980] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:28.570096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 486/981] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:28.843050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.895203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.909008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec1a12-9962-44cb-bbb3-092c9ba41fda None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.909294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec1a12-9962-44cb-bbb3-092c9ba41fda None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.915335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec1a12-9962-44cb-bbb3-092c9ba41fda None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.915335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 487/982] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:28.916163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.916443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.916717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.936522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:28.938106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:28.949995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e11f7b-de6b-4331-a8be-812d14c4d576 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.986263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.986892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.987334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.987612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.988201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.989560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.999340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.002214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:29.003067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 496/983] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.006206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.013106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 488/984] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:29.107731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816dd6-a18c-428c-bb92-5a53c4b8e538 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.122940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.142827 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.143426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.143707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.144039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.144606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.144909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.146337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.155710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 497/985] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:29.159027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.188727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.262618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bebefb-591f-4ae0-a74e-9cb2fad34c4d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.278392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.298614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.299223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.299502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.299776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.300404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.300705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.302091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.312538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 489/986] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.313580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.386489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac90a-4b5b-44a1-b098-7113c0e424bf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.411754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.421336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.422258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.422258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.422574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.423151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.424532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cdd33-993b-484a-9644-fb28ea3d02d7 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.426157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a388c05-5402-437a-a6e9-488717bc6579 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.478897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.479521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.479776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.480047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.480758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] RBAC: Adding query filter params (interface=admin, service_id=c8f3c249249240d1966c0ae54f656fa5, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.481079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.482497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.487662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 490/987] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/endpoints?service_id=c8f3c249249240d1966c0ae54f656fa5&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:29.493131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.497980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 498/988] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:29 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:29.609013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f14c26-7e81-40eb-9b79-4973d6a0a45d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.656224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.656843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.657123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.657398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.658032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.659391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e7f24-5a40-46a9-9ce1-08d5120a626c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.665836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 491/989] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:27:30.209409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467afa2-ba5a-4dae-b20c-1700e1b6e2bd None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.209973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467afa2-ba5a-4dae-b20c-1700e1b6e2bd None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.209973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467afa2-ba5a-4dae-b20c-1700e1b6e2bd None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.211476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 499/990] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:30.217044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.217330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.217608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.236011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:30.237194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:30.248140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.304425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 492/991] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:30.572636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467afa2-ba5a-4dae-b20c-1700e1b6e2bd None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.618194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.685718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467afa2-ba5a-4dae-b20c-1700e1b6e2bd None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.726215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.726931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.727210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.727483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] PATH_INFO: `/v3/services/image` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.728064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.729425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.738721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.739740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:30.741310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 500/992] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.745924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.852447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f16a-f148-4f3c-8ec6-38e07d030805 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.886360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.886963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.887271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.887546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.888172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] RBAC: Adding query filter params (name=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.888476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.889839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa7db4-59e8-4f1c-b78a-5ca9dd2b27ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.895707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 493/993] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.901146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.002493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b291-db0e-42d3-b475-218f6dec901f None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.004052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.037037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.037642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.037921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.038218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.038846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] RBAC: Adding query filter params (type=image) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.039150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.040519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844e592-f145-459b-9533-c912cef1c6aa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.045673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 501/994] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.454823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d435cb-31a9-463d-b1e7-b3595788aaa4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.455182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d435cb-31a9-463d-b1e7-b3595788aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.455384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d435cb-31a9-463d-b1e7-b3595788aaa4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.456772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 494/995] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:31.462217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235610b6-3d8b-4604-9866-bec87cda9966 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.462696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235610b6-3d8b-4604-9866-bec87cda9966 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.462846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235610b6-3d8b-4604-9866-bec87cda9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.483663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-235610b6-3d8b-4604-9866-bec87cda9966 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:31.485190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-235610b6-3d8b-4604-9866-bec87cda9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:31.556935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 502/996] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:31.601506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ce10-aa72-42c0-82b6-856098834ae0 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.601802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ce10-aa72-42c0-82b6-856098834ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.602084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ce10-aa72-42c0-82b6-856098834ae0 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.603550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 495/997] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:31.609127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.609404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.609673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.627922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:31.629090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:31.706049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 503/998] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:31.829009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ce10-aa72-42c0-82b6-856098834ae0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.842422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.937699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ce10-aa72-42c0-82b6-856098834ae0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.971719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.972273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.972550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.972821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.973391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.974787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.983134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:31.983649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:31.985212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:31.986357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:31.989529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 496/999] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:31.990868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.010828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.076706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.094060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c4c7-c4e8-4bdb-b439-6540371a00a4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.102545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10e47f-9d40-425d-8db8-3ab7d1c18ec7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.131894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.132649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.132928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.133199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.133786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.135192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.140658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.141303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.141583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.141853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.142505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.142805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.144168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:32.145660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:32.146632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:32.148283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 504/1000] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:32.156699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 497/1001] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:32.156848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.158685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.252001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.260369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced22876-6ef0-4915-b898-637b5c6de685 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.263194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c2643-0044-40ed-90c4-84f0f419da7a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.295441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.296040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.296317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.296704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.297305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.297603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.298977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.301738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.302373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.302652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.302924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.303551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.304079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.304187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 498/1002] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:32.305372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.310179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.313968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 505/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.314096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.316202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.418393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fe82-ed1f-4add-810e-44934c7f28da None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.422218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445bf94-9109-4ebb-a869-65d7a080ffcc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.456311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.456913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.457185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.457454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.459598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.459598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.459749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.459835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.459921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.460118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.460334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.461023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] RBAC: Adding query filter params (interface=public, service_id=69beb48227db45479d164aff889700c8, region_id=RegionOne) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.461329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.462697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.465091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 506/1004] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.473544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 499/1005] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/endpoints?service_id=69beb48227db45479d164aff889700c8&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:32.473701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.474240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.491406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.542016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.579861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799acc40-987d-4045-bb6f-0f14d8a0cad3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.581615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba29aa-884e-4cae-998d-97a80481f0c6 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.614759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032234f-0337-469f-982b-9b518edca3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.615356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032234f-0337-469f-982b-9b518edca3be None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.615885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032234f-0337-469f-982b-9b518edca3be None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.616154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032234f-0337-469f-982b-9b518edca3be None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.616745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032234f-0337-469f-982b-9b518edca3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.617870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.618127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032234f-0337-469f-982b-9b518edca3be None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.618594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.618901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.619233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.619991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.621283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35616cf7-cee9-4013-9844-870e4cf60784 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.634277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 500/1006] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:27:32.708228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 507/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:32.965218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a7c7-db42-4a16-88cb-992cf1f3b5c9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.966290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a7c7-db42-4a16-88cb-992cf1f3b5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.966368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3a7c7-db42-4a16-88cb-992cf1f3b5c9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.967807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 501/1008] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:32.972902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b25c8-13fa-49fd-b600-fab33bf1026b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.973199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b25c8-13fa-49fd-b600-fab33bf1026b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.973479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b25c8-13fa-49fd-b600-fab33bf1026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.992119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-653b25c8-13fa-49fd-b600-fab33bf1026b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:32.993307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-653b25c8-13fa-49fd-b600-fab33bf1026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:33.068895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 508/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:33.338896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3a7c7-db42-4a16-88cb-992cf1f3b5c9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.442385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3a7c7-db42-4a16-88cb-992cf1f3b5c9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.472023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.478464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.479073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.479354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.479683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.480345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.482445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee016-2b50-4a02-8956-1f74b21223b1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.547597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 502/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:33 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:34.584812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9df00-d300-45cb-859d-db979deaec70 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.585333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9df00-d300-45cb-859d-db979deaec70 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.585456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9df00-d300-45cb-859d-db979deaec70 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.586782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 509/1011] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:34.592474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.592871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.593029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.611763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:34.612956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:34.623344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ad9b-72bf-4810-863f-049dc7ece17e None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.623627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ad9b-72bf-4810-863f-049dc7ece17e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.623933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337ad9b-72bf-4810-863f-049dc7ece17e None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.625529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 510/1012] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:34.630407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.630694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.630977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.638850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.650501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:34.651828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:34.701263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 503/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:34.726429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 511/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:34.972785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.993027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.081961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b54413-859b-4557-97b8-07911e77fcd3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.099467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.099629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e7f3-691e-41c4-a423-0aa171a030b8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.118268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.118905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.119184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.119455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.120036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.121404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:35.130610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:35.131601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:35.132441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 504/1015] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:35.137517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.138746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.139451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.139735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.140012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.141101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.142562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.144255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 512/1016] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:35.149820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.152662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.257225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d07c6-fd46-4439-be5b-4c5f8a902502 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.263762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847608e-591e-4e82-ad38-358f329cef3e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.293739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.295181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.295464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.295739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.296370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.297799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.303150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.303762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.304044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.304318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.304948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.305250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.306632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.311914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 505/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:35.317422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.365305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.370727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 513/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:35.428794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ce78-a0f3-4483-a8d4-772dae21a7ff None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.466849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.467465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.467745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.468015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.468650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.468949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.470347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759481db-1ebf-4e0c-99fd-f1f41577c96a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.480648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 506/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:35.483052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.493510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c09b6-a3f2-4c68-ad7f-9e8b4c103272 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.493839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c09b6-a3f2-4c68-ad7f-9e8b4c103272 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.494117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c09b6-a3f2-4c68-ad7f-9e8b4c103272 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.495619 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 507/1020] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:35.501084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.501396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.501646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.521392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:35.522554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:35.550398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.598845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651832d9-685a-420c-a39a-7faf38883997 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.599463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 508/1021] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:35.636070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.636823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.637203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.638183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.638868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.640331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.713964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 514/1022] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:35.873285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.916699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.978322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcb11d-d5ef-430d-a41b-fed7ef8faf04 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.022738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.023364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.023640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.023938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] PATH_INFO: `/v3/services/image` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.024513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.025857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.034594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.035564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:36.037050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 509/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:35 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:36.041706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.143746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931c60-6eb3-4dae-b836-693103c6c0ac None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.153991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.184419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.185570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.185807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.186114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.186764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] RBAC: Adding query filter params (name=image) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.187064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.188446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.194025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 515/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:36.199519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.299884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.304140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f0f5-fe61-4908-8164-ed79e6ee5f80 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.338459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.339064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.339345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.339621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.340249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.340551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.342063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.347039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 510/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:36.352752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.455216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460ada9-a1fe-4d36-b711-9ebb68f2a279 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.489397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.490025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.490312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.490587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.491552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] RBAC: Adding query filter params (interface=public, service_id=776411a6559b49a8a16a6edb3f46793c, region_id=RegionOne) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.491858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.493233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c527c-2feb-4142-95b8-be8a2423c67d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.498981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 516/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/endpoints?service_id=776411a6559b49a8a16a6edb3f46793c&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:36.504499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.605747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a39f6-01fe-40b3-a1f4-4d2aea6661fb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.639895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.640490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.640770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.641170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.641788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.643236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e464b4e-43f5-4739-bc18-81f97c06a336 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.654208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 511/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:37.354092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a6b6-2f9a-40fd-9c3f-4ae87160aec5 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.354638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a6b6-2f9a-40fd-9c3f-4ae87160aec5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.354638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a6b6-2f9a-40fd-9c3f-4ae87160aec5 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.356115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 517/1028] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:37.361621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559707-f20a-4a2f-8a9f-6dba07dad62a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.361912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559707-f20a-4a2f-8a9f-6dba07dad62a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.362212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f559707-f20a-4a2f-8a9f-6dba07dad62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.381842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6f559707-f20a-4a2f-8a9f-6dba07dad62a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:37.383059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6f559707-f20a-4a2f-8a9f-6dba07dad62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:37.403170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.453969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 512/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:37.715770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a6b6-2f9a-40fd-9c3f-4ae87160aec5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.761467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.779838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f213f-48fa-45a2-bf14-9da26feca0ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.780319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f213f-48fa-45a2-bf14-9da26feca0ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.780529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f213f-48fa-45a2-bf14-9da26feca0ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.785772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 513/1030] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:37.787009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.787284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.787551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.805657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:37.806850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:37.828643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a6b6-2f9a-40fd-9c3f-4ae87160aec5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.865190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.865840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.866386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.866660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.867896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.869651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.871253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 518/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:37.877267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.879552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 514/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:37.977044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d0f4-9b38-4eef-828d-658dbd32bcfb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.984930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.012124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.012724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.013030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.013300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.014060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.015491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.118812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 519/1033] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:38.148320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.244000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.260134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c975897-f983-46d9-8f18-ae59d2256f62 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.298126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.299110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.299393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.299670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.311943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:38.316161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.317169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:38.318073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 515/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:38.323340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.432613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cb2e2-1cd3-4e59-a421-1f7e536531b7 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.468399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.469008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.469342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.469669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.470382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.470685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.472055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb74b2c-b34e-4048-9e9f-0af8df0f0e27 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.485244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 520/1035] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.486517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.583449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd926-e8c9-47ad-9cb3-203ff5f1a9cf None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.583629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd926-e8c9-47ad-9cb3-203ff5f1a9cf None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.583904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd926-e8c9-47ad-9cb3-203ff5f1a9cf None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.585247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 521/1036] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:38.590133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.590421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.590700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.592231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981499d-a08b-4dcc-9b00-4f5929917603 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.612661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:38.614186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:38.632391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.633024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.633304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.633573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.634847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.646041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.647728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.655719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:38.665483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:38.666593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:38.668100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:38.668100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:38.668100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:38.668100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 516/1037] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:38.674042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.699440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 522/1038] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:38.779391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714b69-7d6b-490b-9f99-5a0f0d6c734e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.812403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.813011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.813273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.813549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.814217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:38.814523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.815886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.828558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 517/1039] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:38.834028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.932527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3c28d-c399-4f04-a0fd-519ac8c5493f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.971590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.971798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:38.972227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.972502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.972775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.985490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.987101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:38.999427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:39.001786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:39.007807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 523/1040] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:39.009652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.027037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.034635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.077591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262eb0c-d9ad-40c1-ba64-a3671733626f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.114587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.115210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da2cb-aaa8-4a71-bb98-88e47635958a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.115367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.115695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.116036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] PATH_INFO: `/v3/services/image` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.117225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.119391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.129818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.130859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:39.131716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 518/1041] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:38 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:39.136766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.154186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.155180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.155689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.155921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.156631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.157011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.158500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.176869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 524/1042] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:39.182510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.246030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2698-9d1f-456f-8ee4-185d63a86580 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.266277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.270602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.282766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.283670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.284169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.285138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.286332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.286831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.289279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.297224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 519/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:39.298198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c74bb9-5fe3-47ed-afd3-0cacb45d7c6d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.302786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.340605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.341606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.342072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.342516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.410884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c5f76-5083-4f4b-98ac-217863b8a2c8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.422194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.423504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.446489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.447093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.447373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.447646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.448268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] RBAC: Adding query filter params (type=image) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.448569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.449912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.455082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 520/1044] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:39.460513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.502891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.513249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.534819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 525/1045] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:39.540255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.569216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598d0bb-a527-4934-af6a-17f4c659b359 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.604007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.604611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.604890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.605160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.605811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.607726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.641444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89f445-c4be-498d-81bf-1f1352c6df48 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.675331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.676057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.676275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.676542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.688101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.689551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.709986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 521/1046] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:39.718685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.719792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:39.721384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:39.721384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:39.721384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:39.721384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 526/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:39.725774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.842778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a201ad-9ce2-45ee-9bf1-548e2341afc8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.844730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.882491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.883105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.883384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.883662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.884302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.884604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.885987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.897721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 522/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:39.903236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.931505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.013798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202653-7a6e-4524-a9dd-8bf8a7610972 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.055582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.056213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.056500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.056773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.063697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.065144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-cfd95d13-fc43-44c6-b1cf-4c66148d59d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:40.076716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:40.077594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:40.078617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 527/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:40.084948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.149319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4894-4155-456d-80ea-3067abebc280 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.149607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4894-4155-456d-80ea-3067abebc280 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.149883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4894-4155-456d-80ea-3067abebc280 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.151379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 528/1050] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:40.156850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.157319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.157716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.175784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:40.177112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:40.189861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbc762-af2f-47d2-883b-4247f0848158 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.230094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.230937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.231187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.231527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.232385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.232690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.234141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.246974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 523/1051] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:40.252693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.254606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 529/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:40.277394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.355140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e88020-1385-4588-8a52-5a2e959b7258 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.389743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.390375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.390655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.390927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.391658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] RBAC: Adding query filter params (role.id=052fab47d9bb4c6ba95f4e4e99caa23f, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.391968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.393390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.402152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 524/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=052fab47d9bb4c6ba95f4e4e99caa23f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.536953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.553080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.636999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44ae3c-89c3-42a8-b1f8-8a1bdf075865 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.676711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.677354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.677637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.677909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.688778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:40.693476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:40.694462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:40.695326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 530/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:40.702086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.792500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.808048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0209f-53a8-43d0-8923-a06fda8341c2 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.843804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.844445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.844705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.844954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.845649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.845976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.847389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.858094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 525/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.863569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.942343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.968165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf80a10-80e0-4339-8130-d84d2decf1f8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.003054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.003669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.003947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.004218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] PATH_INFO: `/v3/users/1ec279fb7bc943cbb99e847b8a1206ab` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.018414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] RBAC: Authorizing `identity:get_user(user_id=1ec279fb7bc943cbb99e847b8a1206ab)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.019845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.021634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 531/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/users/1ec279fb7bc943cbb99e847b8a1206ab => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:41.027454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.126181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f368bb0-63d3-4154-8988-4d49dbb53a45 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.160272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.160865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.161140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.161407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.178592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.228306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.229841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.339526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 526/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:41.340790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.440396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6290a-0254-4c4e-8686-b0e08195c353 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.472398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.478173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.478879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.479225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.479573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.480801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.482363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325be69-6b92-4c57-9d08-be933104c236 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.489422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 532/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:41.490472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.541119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.592216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811bff5-4d92-465c-8394-ac6a9abff0b6 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.626516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.627111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.627383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.627651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.628360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=d0472c523e47425ab2e3b4112e5ed518, user.id=1ec279fb7bc943cbb99e847b8a1206ab) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.628659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.630089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f292e9e-20fb-4ee9-a639-24146ba8dcd1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.640670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 527/1059] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/role_assignments?user.id=1ec279fb7bc943cbb99e847b8a1206ab&scope.project.id=d0472c523e47425ab2e3b4112e5ed518&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:41.692712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea512d-746c-4269-95ed-d6421b0e4b95 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.693218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea512d-746c-4269-95ed-d6421b0e4b95 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.693218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea512d-746c-4269-95ed-d6421b0e4b95 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.694567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 533/1060] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:41.700235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846a5d-7e9c-4ed2-bad6-3d4ac3c00d95 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.700518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846a5d-7e9c-4ed2-bad6-3d4ac3c00d95 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.700921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3846a5d-7e9c-4ed2-bad6-3d4ac3c00d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.720626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f3846a5d-7e9c-4ed2-bad6-3d4ac3c00d95 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:41.721841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f3846a5d-7e9c-4ed2-bad6-3d4ac3c00d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:41.801984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 528/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:42.070843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea512d-746c-4269-95ed-d6421b0e4b95 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.173649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea512d-746c-4269-95ed-d6421b0e4b95 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.207477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.208081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.208361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.208635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.274693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.277647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.279687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.307800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae73c-b186-4022-a309-332a9cc293f4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.308517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae73c-b186-4022-a309-332a9cc293f4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.308517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cae73c-b186-4022-a309-332a9cc293f4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.309694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 529/1062] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:42.314923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.315212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.315485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.335636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:42.336876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:42.374917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.392712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 534/1063] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:42.393612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.414229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 530/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:42.492738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.496219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26a0b-407f-4830-91e8-b87c49b99d70 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.530455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.531074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.531348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.531609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.541362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.542837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:42.556829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.557776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:42.559018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:42.559018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:42.559018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:42.559018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 535/1065] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:42.563929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.664902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568baef4-a670-4985-a7d9-c7fcecf60df1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.687617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.706285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.706904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.707186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.707490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.708105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.708523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.709795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.730029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 531/1066] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.803847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5eebd-cd66-42f0-9d37-6da4578d62b0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.840753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716954-0c33-436c-b772-878a395648e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.841482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716954-0c33-436c-b772-878a395648e5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.841766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716954-0c33-436c-b772-878a395648e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.842071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716954-0c33-436c-b772-878a395648e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.853769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716954-0c33-436c-b772-878a395648e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-78716954-0c33-436c-b772-878a395648e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:42.858560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.859651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:42.860620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 536/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:42.865652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.899643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.971984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8035-e9f4-4323-8f2d-1e5cc9ac4194 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.008406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.009006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.009284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.009559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.010251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.010554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.011903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.020877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 532/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.026699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716954-0c33-436c-b772-878a395648e5 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.042912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.129313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716954-0c33-436c-b772-878a395648e5 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.162151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.162777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.163087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.163362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.174152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.175594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:43.189790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.190927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:43.191847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:43.191847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.191847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:43.191847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 537/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:43.196680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.287865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.294059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b11466-235e-45c8-8296-d27d37e80838 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.326904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.327548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.327769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.328038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.328673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.328973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.330372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.343052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 533/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.349278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.415103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.455140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d7604-9314-48fe-b138-3afb25783d36 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.488922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.489542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.489820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.490125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.497667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.499202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-ffb4d483-f4a2-4999-8db0-23e7139b2a67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:43.509985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.510954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:43.511906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 538/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:43.516920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.571663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0dd-b4d7-4d4d-97f0-b74aa8cadd42 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.571867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0dd-b4d7-4d4d-97f0-b74aa8cadd42 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.572151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0dd-b4d7-4d4d-97f0-b74aa8cadd42 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.573521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 539/1072] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:43.578430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.578710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.578983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.597097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:43.598320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:43.616008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fc913-e7af-4a11-aec9-13322da579cc None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.649215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.649810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.650122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.650397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.651123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.651430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.652849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.665016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 540/1073] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:43.672402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.677908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.739124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.782538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746dc1c-6c21-4fe2-a519-561c3d206f62 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.815785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.816437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.816714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.816987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.827682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.829055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:43.843106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.844224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:43.845106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:43.845106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:43.845106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:43.845106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 541/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:43.850210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.864624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.937236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.946161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578749d-86e5-4b92-89dc-deddb199a02b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.981050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.981653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.981951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.982887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.983528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.983900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.985714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.997577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 535/1076] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.003615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.041581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85384d85-fd51-40d8-a3bc-07ce86c7118b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.048833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.072062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.075372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.075993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.076272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.076544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.087714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:44.092294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.093451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:44.094370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 542/1077] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:44.099317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.103782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c248-3a55-4a58-aaa9-c6a0d009008b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.137361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.138004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.138308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.138576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.146247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.147852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:44.158901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.159935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:44.160860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 536/1078] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:44.165707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.199865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b437d66-b499-46ef-908b-9c3c07c67bd8 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.234864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.235463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.235745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.236017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.236676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.236980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.238388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.246716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 543/1079] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.252358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.264291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3030-3a18-4c61-893d-472742cb845a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.280636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.293202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.298719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.299323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.299603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.299879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.300567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.300870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.302324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.314267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 537/1080] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.320232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.353087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35d0de-8588-4e6a-b815-1ef439eef572 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.387540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.388163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.388479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.388754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] PATH_INFO: `/v3/users/1ec279fb7bc943cbb99e847b8a1206ab` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.389892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] RBAC: Authorizing `identity:get_user(user_id=1ec279fb7bc943cbb99e847b8a1206ab)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.391352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.392938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 544/1081] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/users/1ec279fb7bc943cbb99e847b8a1206ab => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.398680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.424688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e02d-87c4-4746-8155-4c45d7b12866 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.458086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.458733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.459288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.459288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/052fab47d9bb4c6ba95f4e4e99caa23f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.461519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=39cdc5dd5bdc44379c4504de359775c6, role_id=052fab47d9bb4c6ba95f4e4e99caa23f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.462975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.494506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.500119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fe0-3722-4ef1-ab11-08ea93c02208 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.532527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.533217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.533519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.533795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.534968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.535483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 538/1082] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:44 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/39cdc5dd5bdc44379c4504de359775c6/roles/052fab47d9bb4c6ba95f4e4e99caa23f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:27:44.538878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db25807-b04c-48ab-9d71-39cd53e25bd1 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.541331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 545/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.547589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.605316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.656540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187a1-9852-474d-967c-6a6991da70fd None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.694543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.695211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.695489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.695762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518/users/1ec279fb7bc943cbb99e847b8a1206ab/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.697667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] RBAC: Authorizing `identity:create_grant(project_id=d0472c523e47425ab2e3b4112e5ed518, user_id=1ec279fb7bc943cbb99e847b8a1206ab, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.699237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e1f18-9289-4c14-beff-8bce13236e6e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.752254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 539/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:44 2022] PUT /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518/users/1ec279fb7bc943cbb99e847b8a1206ab/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:46.464227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008706-9cf4-46fe-b45e-38722b61eaed None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.464755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008706-9cf4-46fe-b45e-38722b61eaed None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.464888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008706-9cf4-46fe-b45e-38722b61eaed None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.466339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 546/1085] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:46.472208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1c49-cbdf-4836-bc88-6d84fab34a4a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.472596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1c49-cbdf-4836-bc88-6d84fab34a4a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.472754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1c49-cbdf-4836-bc88-6d84fab34a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.492932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c5cd1c49-cbdf-4836-bc88-6d84fab34a4a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:46.494132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c5cd1c49-cbdf-4836-bc88-6d84fab34a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:46.558757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 540/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:46.634887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5b02-ad70-4bcc-b033-92d0e54c9e7f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.635175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5b02-ad70-4bcc-b033-92d0e54c9e7f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.635454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5b02-ad70-4bcc-b033-92d0e54c9e7f None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.636795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 547/1087] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:46.642253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.642542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.642815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.660889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:46.662067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:46.698537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:46.729863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 541/1088] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:46.822273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5b02-ad70-4bcc-b033-92d0e54c9e7f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.921870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e5b02-ad70-4bcc-b033-92d0e54c9e7f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:46.954637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.955248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.955528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.955803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.965681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:46.970984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:46.971878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:46.972713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 548/1089] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:46.978375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.997630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.024098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.087391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81f2b-9207-4f49-ab81-06f80ce63b0a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.104931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537027-2453-4096-84dd-9a189d4de1a1 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.121683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.122322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.122601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.122873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.123529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.123829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.125188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.134550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 542/1090] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.140725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.143429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.144051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.144327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.144599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.155473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:47.160228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.161178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:47.162039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 549/1091] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:47.167264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.175494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.239605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac079-5d9b-4b30-b33b-7b73f1424b92 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.250748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.266509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef6011-9bb0-41ce-a4db-0098b6f4755a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.273335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.273977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.274249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.274517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.285866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.287324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.300088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.300681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.300962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:47.301083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.302204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:47.303292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:47.303292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:47.303292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:47.303512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.303512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.303512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.303512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.307272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 543/1092] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:47.308036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.316830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 550/1093] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.317861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.417931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.424739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ff15e-0d15-4649-86e4-188cb44eecbf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.433397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11232-32c7-49be-a197-5e0bc6b71320 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.465529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.466267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.466553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.466888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] PATH_INFO: `/v3/users/1ec279fb7bc943cbb99e847b8a1206ab` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.468024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1ec279fb7bc943cbb99e847b8a1206ab)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.468732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.469330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.469459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.469609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.469880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.470544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.470845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.471084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 551/1094] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/users/1ec279fb7bc943cbb99e847b8a1206ab => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.472191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.477036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.488801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 544/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.489974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.493521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.577704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef30351-3b50-493a-8f5d-8f61ef9d32d9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.591688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335df4e1-6564-46fa-aa2c-07bdcd7ae2d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.611464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.612070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.612349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.612623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.626193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.626814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.627095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.627364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.634335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.635756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:47.647005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:47.648164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:27:47.649678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 545/1096] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:47.653769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.662434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.686384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.687836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.705347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.757470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4e61-8541-496f-9acf-61e599f51552 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.791043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.791573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 552/1097] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:47.791752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.792004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.792280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.793010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.793316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.795302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.798164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.812898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 546/1098] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.818559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.880673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.896819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd369e-ae70-4e48-bd1f-f58d71088c5c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.910611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.917910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f02f9-e5eb-498f-b3da-73ad449f9d24 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.930323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.930937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.931212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.931473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.932575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.934190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.936359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 553/1099] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.942341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.952965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.953564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.953842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.954134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.020538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.022070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.040618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c4b56-e5d9-4ec2-ba6e-5d0634fc16a9 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.073788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.074423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.074706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.074986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.075706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=d0472c523e47425ab2e3b4112e5ed518, user.id=1ec279fb7bc943cbb99e847b8a1206ab) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.076019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.077426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.082695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.097973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 554/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/role_assignments?user.id=1ec279fb7bc943cbb99e847b8a1206ab&scope.project.id=d0472c523e47425ab2e3b4112e5ed518&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:48.125857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 547/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:48.132131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.181981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.237231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9133-2b5f-40a8-8ecd-1cf0dde7aea0 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.270443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.271059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.271339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.271608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.282603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.284052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:48.298355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:48.299375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:48.300282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:48.300282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:48.300282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:48.300282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 555/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:48.305241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.402351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdedb3-9fa4-4305-a8cd-47be8ed36ee1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.435951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.436553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.436831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.437104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.437742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.438076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.439438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.450679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 548/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:48.457145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.550995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.556076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95b046-5644-48ae-ac77-d1c7c633f53c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.589426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.590077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.590352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.590621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.598315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.599732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:48.610540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:48.611427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:27:48.612309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 556/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:48.617776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.643677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.717858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85777c-a378-4e6c-bf12-66b83c8f3b05 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.757478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.758115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.758389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.758683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.759369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.759665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.761519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f893ba-8642-4f0d-9026-1d75849f3e21 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.774415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 549/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:48.780544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.877288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54df28b-6ea3-4b71-a467-a9c3c74a210d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.911057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.911640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.911918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.912187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.912898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] RBAC: Adding query filter params (role.id=052fab47d9bb4c6ba95f4e4e99caa23f, scope.project.id=f090099f7a4443abba863c4002872264, user.id=39cdc5dd5bdc44379c4504de359775c6) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.913201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.914649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b538f-4121-47a0-b534-c6436c075765 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:48.920239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 557/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/role_assignments?user.id=39cdc5dd5bdc44379c4504de359775c6&scope.project.id=f090099f7a4443abba863c4002872264&role.id=052fab47d9bb4c6ba95f4e4e99caa23f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.032248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c7b5-597f-4616-8d40-0f32afcfb527 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.032768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c7b5-597f-4616-8d40-0f32afcfb527 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.032768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7c7b5-597f-4616-8d40-0f32afcfb527 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.034072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 550/1107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:50.039464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.039869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.040019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.057810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:50.059032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:50.078336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.126907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 558/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:50.398672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7c7b5-597f-4616-8d40-0f32afcfb527 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.482306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.499490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7c7b5-597f-4616-8d40-0f32afcfb527 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.533511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.534155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.534435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.534706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.535800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.537226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bf3ba-a0b8-457a-bc3b-30e82f5c3377 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.538803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 551/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.544443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.641227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3adf8-e020-4a54-913d-2eea66089a95 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.675574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.676105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.676382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.676654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.677305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.678750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493b412-30d7-45f1-92e5-d885cea0543c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.780969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 559/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:50 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:52.703233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e3ea-743d-41fa-b10e-fcebac9f6c1d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.703677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e3ea-743d-41fa-b10e-fcebac9f6c1d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.703789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e3ea-743d-41fa-b10e-fcebac9f6c1d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.705141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 552/1111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:52.710565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:52.710951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:52.711108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:52.735070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:52.736845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:52.739869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:52.821613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 560/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:53.084822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92e3ea-743d-41fa-b10e-fcebac9f6c1d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.194094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92e3ea-743d-41fa-b10e-fcebac9f6c1d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.226428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.227039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.227315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.227586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] PATH_INFO: `/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.228946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] RBAC: Authorizing `identity:get_role(role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.230323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.231669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 553/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.237721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.333209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8e2ef-61a9-4324-bd43-06ccb436a98a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.365225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.365845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.366155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.366430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] PATH_INFO: `/v3/users/f1b1b2389af14ee6bba9b4567905a7bd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.374807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.380114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] RBAC: Authorizing `identity:get_user(user_id=f1b1b2389af14ee6bba9b4567905a7bd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.381553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.383175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 561/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/users/f1b1b2389af14ee6bba9b4567905a7bd => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.388775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.411338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.494040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d004eb-0395-4d22-817b-522cd4fd659e None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.527042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.527625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.527900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.528168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.592479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.593664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.613511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.688796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 554/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:53.694741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.791183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ade3-33e9-483e-a1bd-d288c307eb4d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.829241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.829861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.830164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.830437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.831528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.832943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3864cc3-cceb-486b-8018-b88ef8ddebfa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.834577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 562/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.840660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.937094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb6e97-eb39-43b7-a32f-4d570b6e84b3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.956252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.969997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.970588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.970865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.971139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.971858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=d0472c523e47425ab2e3b4112e5ed518, user.id=f1b1b2389af14ee6bba9b4567905a7bd) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:53.972161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.973569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cac2ed-32e1-42f1-93ae-0264e7d30759 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.978802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 555/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/role_assignments?user.id=f1b1b2389af14ee6bba9b4567905a7bd&scope.project.id=d0472c523e47425ab2e3b4112e5ed518&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:55.833927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801750f-ef0c-4b40-b476-d72ada7dca70 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.834489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801750f-ef0c-4b40-b476-d72ada7dca70 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.834589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801750f-ef0c-4b40-b476-d72ada7dca70 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.835901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 563/1118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:55.841255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.841656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.841800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.860737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:55.861917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:55.926410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 556/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:56.191423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801750f-ef0c-4b40-b476-d72ada7dca70 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.255163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.292190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801750f-ef0c-4b40-b476-d72ada7dca70 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.325917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.326557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.326835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.327627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] PATH_INFO: `/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.329001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] RBAC: Authorizing `identity:get_role(role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.330390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.331690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 564/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.337391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.432549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa1a13-b9b0-4888-bc8a-cca24c59bd24 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.446450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.465985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.466776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.467270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.468066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] PATH_INFO: `/v3/users/f1b1b2389af14ee6bba9b4567905a7bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.469575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] RBAC: Authorizing `identity:get_user(user_id=f1b1b2389af14ee6bba9b4567905a7bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.471038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.472621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 557/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/users/f1b1b2389af14ee6bba9b4567905a7bd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.478232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.574478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94eb66-f850-4082-9d19-084a1e7bb072 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.602623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.607293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.607905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.608210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.608482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.609575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.611192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59325d-2938-432d-b459-91b3993e9d90 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.612800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 565/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.619024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.716610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4109-fa13-423d-b68e-376586143768 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.750527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.751170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.751449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.751724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518/users/f1b1b2389af14ee6bba9b4567905a7bd/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.753860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0472c523e47425ab2e3b4112e5ed518, user_id=f1b1b2389af14ee6bba9b4567905a7bd, role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.755323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770432b-908f-46c3-8862-fe714614e4b3 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.838251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 558/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:56 2022] PUT /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518/users/f1b1b2389af14ee6bba9b4567905a7bd/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:58.717662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784f0c-272d-4503-b805-55cbac1ee225 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.718146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784f0c-272d-4503-b805-55cbac1ee225 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.718244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53784f0c-272d-4503-b805-55cbac1ee225 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.719583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 566/1124] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:58.724612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.725035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.725138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.742786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:58.744220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:58.778866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:58.808813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 559/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:59.089592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53784f0c-272d-4503-b805-55cbac1ee225 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.190546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53784f0c-272d-4503-b805-55cbac1ee225 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.223419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.224063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.224345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.224619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] PATH_INFO: `/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.226047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] RBAC: Authorizing `identity:get_role(role_id=a29763ef69ec4f10ba8540c08b89e4fc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.227425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.228738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 567/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/roles/a29763ef69ec4f10ba8540c08b89e4fc => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.235024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.331233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560c54-2e1e-4663-9901-1c6cc81a97fd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.364720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.365332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.365610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.365884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] PATH_INFO: `/v3/users/f1b1b2389af14ee6bba9b4567905a7bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.367019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] RBAC: Authorizing `identity:get_user(user_id=f1b1b2389af14ee6bba9b4567905a7bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.368694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.370288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 560/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/users/f1b1b2389af14ee6bba9b4567905a7bd => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.376047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.443953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.486860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd6d6-18d5-4319-b795-416b64d1af0b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.519195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.519784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.520059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.520328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.587436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.588864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.650423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.683923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 568/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:59.689721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.731841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.791687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91898f1-1e32-4f08-adf5-0d1124bc4394 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.826993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.828139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.828418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.828691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] PATH_INFO: `/v3/projects/d0472c523e47425ab2e3b4112e5ed518` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.829799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] RBAC: Authorizing `identity:get_project(project_id=d0472c523e47425ab2e3b4112e5ed518)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.831264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad15e-c8bf-4098-8ed8-efe7259df9ed None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.832898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 561/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/projects/d0472c523e47425ab2e3b4112e5ed518 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.839209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.937041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e83ac9-2d8f-4dd1-8776-a3cf884f1711 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.969901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.970525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.970803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.971073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.971799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] RBAC: Adding query filter params (role.id=a29763ef69ec4f10ba8540c08b89e4fc, scope.project.id=d0472c523e47425ab2e3b4112e5ed518, user.id=f1b1b2389af14ee6bba9b4567905a7bd) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:59.972106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.973527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009354d-0a3d-4e05-a4b5-0a355e049a82 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.979183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 569/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/role_assignments?user.id=f1b1b2389af14ee6bba9b4567905a7bd&scope.project.id=d0472c523e47425ab2e3b4112e5ed518&role.id=a29763ef69ec4f10ba8540c08b89e4fc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:01.912143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba7e2-18de-430b-bb76-3dd8e1960f93 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.912684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba7e2-18de-430b-bb76-3dd8e1960f93 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.912684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecba7e2-18de-430b-bb76-3dd8e1960f93 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.914061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 562/1131] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:01.919223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.919649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.919775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.937351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:01.938546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:01.963739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.004461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 570/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:02.269341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecba7e2-18de-430b-bb76-3dd8e1960f93 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.368990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecba7e2-18de-430b-bb76-3dd8e1960f93 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.377880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.401349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.401989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.402275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.402548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.403652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.405073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa530e5-9030-430a-b20a-d9fecfc9147b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.407169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 563/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.412904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.510697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd07cec-bb46-44c0-b405-6ba3c2533a31 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.543508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.544039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.544318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.544589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.545239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.547346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970731cf-7597-4809-8af2-cf264c13834a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.640703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 571/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:02 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:04.559183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd19ee-a194-46e9-8819-30d4a90820b4 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.559747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd19ee-a194-46e9-8819-30d4a90820b4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.559747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd19ee-a194-46e9-8819-30d4a90820b4 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.561075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 564/1135] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:04.566211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.566599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.566752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.584200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:04.585370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:04.594743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:04.649871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 572/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:04.915734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd19ee-a194-46e9-8819-30d4a90820b4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.015503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd19ee-a194-46e9-8819-30d4a90820b4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.048290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.048898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.049179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.049456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.050571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.051984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd49039-e773-492b-8058-1d8efe49edce None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.053523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 565/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:05.059097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.153800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f1b3-e949-4fda-b20e-4ab86e0d6b82 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.187901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.188424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.188695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.188958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.189597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.191041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad27f0b-be38-4291-99af-adc467bfee5e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.286617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.291470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 573/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:05 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:07.271634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de48a-3ddc-484d-97aa-177bdee53fbf None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.272193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de48a-3ddc-484d-97aa-177bdee53fbf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.272193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513de48a-3ddc-484d-97aa-177bdee53fbf None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.273509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 566/1139] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:07.279032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.279419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.279575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.297646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:07.298843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:07.362269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 574/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:07.641298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de48a-3ddc-484d-97aa-177bdee53fbf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.688644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.743252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513de48a-3ddc-484d-97aa-177bdee53fbf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.776504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.777119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.777416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.777672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.788040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:07.792698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:07.793863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:07.794985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 567/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:07.800433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:07.896627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69154e3e-16b9-49df-8a94-cb598ac2a9f8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:07.924262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.929858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:07.934274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:07.941746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 575/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:07.947275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.045437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9eb8d-e04b-4eeb-88a2-b8ab93545809 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.047728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.077222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.077837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.078646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.078978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] PATH_INFO: `/v3/users/c48b98106ea945caa020e476b26a3005` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.092144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] RBAC: Authorizing `identity:get_user(user_id=c48b98106ea945caa020e476b26a3005)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.093561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.095753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 568/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:07 2022] GET /identity/v3/users/c48b98106ea945caa020e476b26a3005 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:08.101562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.201897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc31b1-f548-463d-bef3-202103ba3efb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.239700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.240297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.240577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.240852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.297138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.306280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.310042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.403571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 576/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:08.409699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.508425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696ae5e-4126-4d79-96d2-047f8900c82a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.547747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.548367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.548652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.548923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] PATH_INFO: `/v3/projects/0428f7f222014fb6959f0cd6ea4159a3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.550055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] RBAC: Authorizing `identity:get_project(project_id=0428f7f222014fb6959f0cd6ea4159a3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.551478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e61ac-0b05-4830-9b93-8a9015ddc406 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.553105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 569/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/projects/0428f7f222014fb6959f0cd6ea4159a3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:08.561772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.650221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.659087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350d0a3-4f52-49a3-b45c-58a1c1d5e94a None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.692178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.692783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.693468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.693468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.694076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=0428f7f222014fb6959f0cd6ea4159a3, user.id=c48b98106ea945caa020e476b26a3005) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:08.694388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.695859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447c2b-9b13-48d4-adee-44de52c8fe1a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.701203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 577/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/role_assignments?user.id=c48b98106ea945caa020e476b26a3005&scope.project.id=0428f7f222014fb6959f0cd6ea4159a3&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:10.556365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ea0c-dde0-42bf-a122-c1cdf2e72b00 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.556918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ea0c-dde0-42bf-a122-c1cdf2e72b00 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.556918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9ea0c-dde0-42bf-a122-c1cdf2e72b00 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.558289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 570/1147] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:10.563910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.564323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.564465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.582722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:10.583910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:10.648303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 578/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:10.916684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9ea0c-dde0-42bf-a122-c1cdf2e72b00 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.949891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.020254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9ea0c-dde0-42bf-a122-c1cdf2e72b00 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.053282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.053894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.054211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.054486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.064330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:11.068967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:11.070060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:11.071111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 571/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:11.076106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.158253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.172201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303afe8c-9d40-490e-8205-3b8952c8abdf None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.207282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.207881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.208154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.208423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.209082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:11.209379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.210767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.219273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 579/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.225251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.314559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.324126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25047-2ea3-4c01-b681-ba4ad63184e3 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.358263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.358878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.359157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.359427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] PATH_INFO: `/v3/users/c48b98106ea945caa020e476b26a3005` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.360561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] RBAC: Authorizing `identity:get_user(user_id=c48b98106ea945caa020e476b26a3005)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.361994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.363559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 572/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/users/c48b98106ea945caa020e476b26a3005 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.369614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.466456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b19f1-1439-488d-88f8-5b79f38819cc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.498568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.499175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.499460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.499731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] PATH_INFO: `/v3/projects/0428f7f222014fb6959f0cd6ea4159a3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.501351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] RBAC: Authorizing `identity:get_project(project_id=0428f7f222014fb6959f0cd6ea4159a3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.502798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90c6f-54e7-4ff6-8d19-3bea084973f2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.504389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 580/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/projects/0428f7f222014fb6959f0cd6ea4159a3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.510177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.607714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f183-f3a9-4f9f-b83b-a05067f70f83 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.642231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.642867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.643142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.643413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] PATH_INFO: `/v3/projects/0428f7f222014fb6959f0cd6ea4159a3/users/c48b98106ea945caa020e476b26a3005/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.645269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] RBAC: Authorizing `identity:create_grant(project_id=0428f7f222014fb6959f0cd6ea4159a3, user_id=c48b98106ea945caa020e476b26a3005, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.646702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a2968-8c93-4102-9faa-a53784766f05 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.714588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 573/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:11 2022] PUT /identity/v3/projects/0428f7f222014fb6959f0cd6ea4159a3/users/c48b98106ea945caa020e476b26a3005/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:13.596062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14093-96d1-488b-a618-417c96db5e73 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.596625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14093-96d1-488b-a618-417c96db5e73 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.596625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14093-96d1-488b-a618-417c96db5e73 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.597961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 581/1154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:13.603194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.603560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.603735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.623457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:13.624646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:13.638077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:13.691409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 574/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:13.956946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14093-96d1-488b-a618-417c96db5e73 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:13.975260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.056757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14093-96d1-488b-a618-417c96db5e73 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.089159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.089767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.090073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.090346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.100082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:14.104685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.105786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:28:14.107019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 582/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:14.112312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.207982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96061ed2-98cb-4779-826e-9e4f5b20d101 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.241569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.242201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.242482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.242753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.243417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.243719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.245342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.253254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 575/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.259029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.338906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.360507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0eac7-d4ee-4644-87ff-536a30dac065 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.395442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.396057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.396337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.396611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] PATH_INFO: `/v3/users/c48b98106ea945caa020e476b26a3005` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.397714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] RBAC: Authorizing `identity:get_user(user_id=c48b98106ea945caa020e476b26a3005)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.399175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.400739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 583/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/users/c48b98106ea945caa020e476b26a3005 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.406693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.419271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.507183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf7376-4387-4c83-97df-b4e8bd8164e0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.540324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.540919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.541198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.541547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.612848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.614317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.625452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.715026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 576/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:14.720890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.817824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726c845-6092-4143-9592-6fd995cb2f26 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.849266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.849874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.850182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.850457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] PATH_INFO: `/v3/projects/0428f7f222014fb6959f0cd6ea4159a3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.851550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] RBAC: Authorizing `identity:get_project(project_id=0428f7f222014fb6959f0cd6ea4159a3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.852973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1c157-2e00-40d5-8e8f-4330e3218436 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.854608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 584/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/projects/0428f7f222014fb6959f0cd6ea4159a3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.861051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.957896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d435-c5ae-4fb0-a79d-fb27e12bbbb9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.968450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.992159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.992856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.993136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.993410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.994161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=0428f7f222014fb6959f0cd6ea4159a3, user.id=c48b98106ea945caa020e476b26a3005) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.994472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.996144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e24c3-471a-489c-a960-2a757870f586 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:15.002442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 577/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/role_assignments?user.id=c48b98106ea945caa020e476b26a3005&scope.project.id=0428f7f222014fb6959f0cd6ea4159a3&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:16.931754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531c25-0f64-4e99-8299-cf0afba1bc58 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:16.932274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531c25-0f64-4e99-8299-cf0afba1bc58 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:16.932274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c531c25-0f64-4e99-8299-cf0afba1bc58 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:16.933633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 585/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:16.938981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:16.939397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:16.939531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:16.958459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:16.959583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:17.025220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 578/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:17.292465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531c25-0f64-4e99-8299-cf0afba1bc58 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.307814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.393017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c531c25-0f64-4e99-8299-cf0afba1bc58 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.424731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.425315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.425590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.425858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.489241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.490695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.504072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.584858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 586/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:17.590647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.687482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54046376-a993-4303-826c-bbfa762bbba7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.690387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.720800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.721488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.722074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.722345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.728684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.730141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2c94a8fc-a364-4027-8d8f-1fc7f3069236 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:17.741529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:17.742788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:17.743827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 579/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:17.748951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.844367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e66e0a-a424-483c-a5e0-580d3cbf4333 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.856761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.877839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.878465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.878742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.879016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.879646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:17.879946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.881297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efb7-e3a8-4a02-8228-7d1a67e17e92 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.888073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 587/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:19.764801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5720d-3b03-4c56-b30d-ad4618bdf63e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.765312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5720d-3b03-4c56-b30d-ad4618bdf63e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.765417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5720d-3b03-4c56-b30d-ad4618bdf63e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.767403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 580/1167] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:19.772369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e48ff-8926-45d3-88ee-759081860fc1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:19.772778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e48ff-8926-45d3-88ee-759081860fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:19.772917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e48ff-8926-45d3-88ee-759081860fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:19.790539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a60e48ff-8926-45d3-88ee-759081860fc1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:19.791711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a60e48ff-8926-45d3-88ee-759081860fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:19.855428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 588/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:20.122203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5720d-3b03-4c56-b30d-ad4618bdf63e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:20.220839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5720d-3b03-4c56-b30d-ad4618bdf63e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:20.253817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:20.254435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.254717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.254991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.255652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:20.257010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb57a7-d3ea-4f2e-8246-90fe07f8fe5e None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:20.339140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 581/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Aug 24 03:28:20 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:22.272341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ba12-2f12-4adc-9837-2c60927dd0bb None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:22.272873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ba12-2f12-4adc-9837-2c60927dd0bb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:22.272873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0ba12-2f12-4adc-9837-2c60927dd0bb None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:22.274280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 589/1170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:22.280466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:22.280865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:22.281019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:22.299801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:22.300985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:22.318442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:22.366746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 582/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:22.636300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0ba12-2f12-4adc-9837-2c60927dd0bb None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:22.736422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0ba12-2f12-4adc-9837-2c60927dd0bb None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:22.743544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:22.768789 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:22.769408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:22.769690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:22.769989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] PATH_INFO: `/v3/domains/b3fe5334a3fb4952b59505e1c39f999a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:22.779948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] RBAC: Authorizing `identity:get_domain(domain_id=b3fe5334a3fb4952b59505e1c39f999a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:22.781378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b7d2-208d-4e32-b97c-a71c677d223c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:22.783898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 590/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:22 2022] GET /identity/v3/domains/b3fe5334a3fb4952b59505e1c39f999a => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:22.789319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:22.884948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0cbf1-765f-448e-9fab-9c0d24a8ff58 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:22.918247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:22.918774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:22.919054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:22.919326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:22.919967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:22.921379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f940-e272-438e-85e7-0df6826cf30c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:23.037439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 583/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:22 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:24.973314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f1ff7-b7a4-4245-ae50-c6fbb777123a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.973837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f1ff7-b7a4-4245-ae50-c6fbb777123a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.973837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f1ff7-b7a4-4245-ae50-c6fbb777123a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.975161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 591/1174] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:24.980239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32167-e022-4921-a646-a92d02c2afae None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:24.980678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32167-e022-4921-a646-a92d02c2afae None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:24.980782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a32167-e022-4921-a646-a92d02c2afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:24.994098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.999603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-92a32167-e022-4921-a646-a92d02c2afae None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:25.000779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92a32167-e022-4921-a646-a92d02c2afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:25.066277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 584/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:25.334510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f1ff7-b7a4-4245-ae50-c6fbb777123a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:25.435033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f1ff7-b7a4-4245-ae50-c6fbb777123a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:25.469154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:25.469765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:25.470072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:25.470460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] PATH_INFO: `/v3/domains/b3fe5334a3fb4952b59505e1c39f999a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:25.471567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b3fe5334a3fb4952b59505e1c39f999a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:25.473518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86224efe-8fc5-440b-bc6f-be4e0c84c7b5 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:25.475153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 592/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:25 2022] GET /identity/v3/domains/b3fe5334a3fb4952b59505e1c39f999a => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:25.481008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a32167-e022-4921-a646-a92d02c2afae None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:25.576768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a32167-e022-4921-a646-a92d02c2afae None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:25.609319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:25.609905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:25.610213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:25.610484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:25.611148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:25.612561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5dcd3-15d6-412d-8e55-c3795bfac926 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:25.621341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:25.698487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 585/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:25 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:27.627654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c6d7-3fd0-479d-97b4-926f089ac0e6 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.628275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c6d7-3fd0-479d-97b4-926f089ac0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.628275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c6d7-3fd0-479d-97b4-926f089ac0e6 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.629524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 593/1178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:27.634864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:27.635249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:27.635442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:27.653142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:27.654360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:27.719661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 586/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:27.994062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c6d7-3fd0-479d-97b4-926f089ac0e6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.029340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.094153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c6d7-3fd0-479d-97b4-926f089ac0e6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.127971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.128642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.128919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.129196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.138944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:28.143572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:28.144751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:28:28.146044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 594/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:28.150623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.246094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb802c-bbe9-478e-86d0-e301a9500914 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.268123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.279128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.279711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.279985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.280254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.280926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:28.281215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:28.282596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:28.290810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 587/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:28.296639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.387729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.394168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f003f-3d68-4a41-84ae-48f1690d4e24 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.426667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.427319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.427602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.427874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] PATH_INFO: `/v3/users/a6d4578ea5db48d0973c7aac55807694` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.441476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d4578ea5db48d0973c7aac55807694)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:28.442952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:28.444579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 595/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/users/a6d4578ea5db48d0973c7aac55807694 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:28.450555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.549546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dac96-acd2-496f-8375-91ce9a660120 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.582324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.582915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.583242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.583518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.634050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.648974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:28.650451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:28.748806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 588/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:28.754831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.852106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983421c-b55e-464f-ac09-bbb6a44b8412 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.884872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.885489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.885771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.886079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] PATH_INFO: `/v3/projects/0d30876ffc1844cfa4f11fad6576404c` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.887257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] RBAC: Authorizing `identity:get_project(project_id=0d30876ffc1844cfa4f11fad6576404c)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:28.888691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd361e0-f77c-4baa-b6cc-8f6ad4692e24 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:28.890333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 596/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/projects/0d30876ffc1844cfa4f11fad6576404c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:28.896884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.977172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:28.992362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5edc-74c6-455c-87cd-fc2951fc9edb None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.025725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:29.026325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.026598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.026865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.027574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=0d30876ffc1844cfa4f11fad6576404c, user.id=a6d4578ea5db48d0973c7aac55807694) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:29.027876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:29.029269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868fd5c-2f6e-420f-859a-6a769cecd875 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:29.034431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 589/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/role_assignments?user.id=a6d4578ea5db48d0973c7aac55807694&scope.project.id=0d30876ffc1844cfa4f11fad6576404c&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:30.895926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93bd4-eaa4-4abe-87ab-1d247d0335f3 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.896441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93bd4-eaa4-4abe-87ab-1d247d0335f3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.896552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec93bd4-eaa4-4abe-87ab-1d247d0335f3 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.897808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 597/1186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:30.903030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:30.903430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:30.903578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:30.921152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:30.922377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:30.986939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 590/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:31.253798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93bd4-eaa4-4abe-87ab-1d247d0335f3 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.274878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.352204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec93bd4-eaa4-4abe-87ab-1d247d0335f3 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.392515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.393378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.393765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.394204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.406403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:31.411437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:31.412677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:28:31.414819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 598/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:31.419002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.496027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.518065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a15f-6da7-4030-8e62-15986f779876 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.552127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.552722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.553002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.553274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.553955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:31.554261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.555617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.563409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 591/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:31.569385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.648495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.667231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aace2-5330-4615-9f69-23c236158375 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.703569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.704663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.705120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.705627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] PATH_INFO: `/v3/users/a6d4578ea5db48d0973c7aac55807694` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.707450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d4578ea5db48d0973c7aac55807694)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.708899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.710561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 599/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/users/a6d4578ea5db48d0973c7aac55807694 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:31.716387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.815982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c4897-db7c-44c5-8afd-b491f9e00615 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.849384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.850113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.850396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.850669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] PATH_INFO: `/v3/projects/0d30876ffc1844cfa4f11fad6576404c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.851778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] RBAC: Authorizing `identity:get_project(project_id=0d30876ffc1844cfa4f11fad6576404c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.853196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669b424-713e-45a9-841f-e697d969fd01 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.854848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 592/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/projects/0d30876ffc1844cfa4f11fad6576404c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:31.860830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.957020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ea6c-3dca-4a7d-b575-878725089443 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.993196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.993895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.994663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.994944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] PATH_INFO: `/v3/projects/0d30876ffc1844cfa4f11fad6576404c/users/a6d4578ea5db48d0973c7aac55807694/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.997159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d30876ffc1844cfa4f11fad6576404c, user_id=a6d4578ea5db48d0973c7aac55807694, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.999062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa879b38-38d6-416e-8988-3ceed1071f1f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.082242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 600/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:31 2022] PUT /identity/v3/projects/0d30876ffc1844cfa4f11fad6576404c/users/a6d4578ea5db48d0973c7aac55807694/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:28:33.968014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4968-4f96-4080-b2dd-7447d8cf0db8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:33.968543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4968-4f96-4080-b2dd-7447d8cf0db8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:33.968543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4968-4f96-4080-b2dd-7447d8cf0db8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:33.969883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 593/1193] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:33.975508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:33.975927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:33.976061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:33.994565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:33.996676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:34.000077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:34.067530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 601/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:34.340120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4968-4f96-4080-b2dd-7447d8cf0db8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:34.353271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:34.443417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4968-4f96-4080-b2dd-7447d8cf0db8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:34.475568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:34.476178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.476629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.477067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.491993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:34.496929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:34.498041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:28:34.499207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 594/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:34.504101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:34.600020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ab91b-7d7c-4136-a512-779889256c4f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:34.632670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:34.633260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.633539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.633812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.634505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:34.634807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:34.636170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:34.640925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:34.644256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 602/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:34.650364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:34.715028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:34.749305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb2b7e-de9b-4a9b-9cfb-f3c6cff1a0a5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:34.781323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:34.781926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.782230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.782500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] PATH_INFO: `/v3/users/a6d4578ea5db48d0973c7aac55807694` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.783594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] RBAC: Authorizing `identity:get_user(user_id=a6d4578ea5db48d0973c7aac55807694)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:34.785666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:34.787244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 595/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:34 2022] GET /identity/v3/users/a6d4578ea5db48d0973c7aac55807694 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:34.793195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:34.890025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b88cf-2a68-4bf0-9dc9-8768da6dfa2d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:34.922422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:34.923005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.923280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.923547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.984980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:34.987150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:34.988563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.081793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 603/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:35.087669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.183926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc83ea-b6cc-4880-828d-23b7fccfa10b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.216421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.217029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.217307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.217578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] PATH_INFO: `/v3/projects/0d30876ffc1844cfa4f11fad6576404c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.218701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] RBAC: Authorizing `identity:get_project(project_id=0d30876ffc1844cfa4f11fad6576404c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.220108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241d8de-597e-452b-8826-35f56b89c639 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.222296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 596/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/projects/0d30876ffc1844cfa4f11fad6576404c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:35.228253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.321514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:35.324419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2d04e-64e7-441a-8849-89550efcb051 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.357618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.358232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.358514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.358787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.359513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=0d30876ffc1844cfa4f11fad6576404c, user.id=a6d4578ea5db48d0973c7aac55807694) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:35.359817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.361230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1ec1-810b-42c9-a87a-603fdcc07108 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.366994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 604/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/role_assignments?user.id=a6d4578ea5db48d0973c7aac55807694&scope.project.id=0d30876ffc1844cfa4f11fad6576404c&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:45.212385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:45.364433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=18 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:48.999721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567e1f-9e56-4d09-9761-b008528cb0cc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:49.000270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567e1f-9e56-4d09-9761-b008528cb0cc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:49.000270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567e1f-9e56-4d09-9761-b008528cb0cc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:49.001536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 597/1201] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:49.006975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b756-e6c1-437c-962f-70635f901124 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:49.007389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b756-e6c1-437c-962f-70635f901124 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:49.007522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b756-e6c1-437c-962f-70635f901124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:49.025769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5304b756-e6c1-437c-962f-70635f901124 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:49.026972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5304b756-e6c1-437c-962f-70635f901124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:49.092790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 605/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:49.368075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567e1f-9e56-4d09-9761-b008528cb0cc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:49.470218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567e1f-9e56-4d09-9761-b008528cb0cc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:49.504793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:49.505404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:49.505681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:49.505961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:49.516398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:49.517819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:49.531757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:49.532759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:49.533729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:49.533729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:49.533729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:29:49.533729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 598/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:49.539449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b756-e6c1-437c-962f-70635f901124 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:49.636289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304b756-e6c1-437c-962f-70635f901124 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:49.664944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:49.670688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:49.688929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529c16e-499e-43e2-9888-7bbb073e30fc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:49.689473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 606/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:49.690919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:49.751446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:49.799048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec408-3fc4-4efa-8ccf-126ddd470c8d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:49.830547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:49.831145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:49.831469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:49.831699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:49.832845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:49.834362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f54b6-c533-436d-ac41-c690e03fa89c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:49.964864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 599/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 24 03:29:49 2022] POST /identity/v3/users => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:29:51.907704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cfafa-2572-48ae-8916-653722e05046 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:51.908262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cfafa-2572-48ae-8916-653722e05046 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:51.908262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cfafa-2572-48ae-8916-653722e05046 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:51.909637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 607/1206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:51.915178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:51.915591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:51.915740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:51.934010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:51.935206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:52.002088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 600/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:52.276537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cfafa-2572-48ae-8916-653722e05046 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:52.376562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cfafa-2572-48ae-8916-653722e05046 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:52.409668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:52.410826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:52.411108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:52.411378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:52.421241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:29:52.425903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:52.427675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:52.428740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 608/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:29:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:52.433884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:52.471751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:52.529491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9969a-0316-4d16-95df-f1ed767ebef8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:52.563127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:52.563729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:52.564010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:52.564285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:52.564946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:52.565247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:52.566666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:52.574362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 601/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:29:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:52.580288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:52.631976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:52.681025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06be94-d4c8-4913-b430-d7f8dd171b9c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:52.715245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:52.715887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:52.716171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:52.716445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:52.727483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:52.728929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:52.743661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:52.744775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:52.745880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:52.745880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:52.745880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:52.745880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 609/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:52.750976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:52.847723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:52.851154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946071-ec0b-4687-8504-f01aff8020c5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:52.883865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:52.884456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:52.884734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:52.885005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:52.885641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:52.885967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:52.887331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:52.899331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 602/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:52.905204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.003834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1997dc4-a840-4432-b02a-59547eac63e2 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.005586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:53.038087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.038704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.038983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.039255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.046300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:53.047729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:29:53.059022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:53.060094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:53.061327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 610/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:53.066255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.164084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c462-330e-43e1-ba70-3d6bce646e3b None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.196604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.197229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.197508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.197781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.198525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:53.198831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:53.200243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:53.217436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 603/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:29:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:53.223858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.323195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229952f-8676-4cf5-86df-759e9c247755 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.356736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.357382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.357660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.357960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.387577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:53.426390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:53.427771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:53.526395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 611/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:29:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:53.532402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.550996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:53.630303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0aba-a557-40c6-87b4-f217ecb1b7df None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.664154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.664769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.665049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.665322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.675219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:53.676699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:53.690946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:53.692622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:53.693741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:53.693741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:53.693741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:29:53.693741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 604/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:53.699472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.761401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:53.802349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12de71-c119-4d36-b661-a866b91e8189 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.836363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.836971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.837249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.837523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.838246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:53.838551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:53.839923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:53.851340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 612/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:53.857147 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:53.925830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:53.957258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c2dc6-d51b-4df5-b22e-ef1e21c0b412 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:53.990799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:53.991423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:53.991702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:53.991974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:53.998676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:54.000104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:29:54.012091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:54.018156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:29:54.019293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 605/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:54.020499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:54.127456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a2f9-887c-4ec4-a51e-92ea607c17bf None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:54.150578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:54.162362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:54.162960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:54.163258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:54.163589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:54.164573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:54.164886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:54.166486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4a38d-4ae0-4041-ae44-179474728d63 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:54.177814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 613/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:29:54.184019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:54.284881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1939b3-5950-4090-b022-1ab3d65c1747 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:54.313255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:54.319712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:54.320293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:54.320571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:54.320840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:54.321627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=86cdd101e8d840be856ace9511917a3b) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:54.321958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:54.323380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44b575-fb2f-4a11-959b-d21c0ddec577 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:54.328622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 606/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:29:54 2022] GET /identity/v3/role_assignments?user.id=86cdd101e8d840be856ace9511917a3b&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:56.216412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145ce9-404d-4904-a8ab-4f07f2ad6b5a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:56.216988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145ce9-404d-4904-a8ab-4f07f2ad6b5a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:56.216988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145ce9-404d-4904-a8ab-4f07f2ad6b5a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:56.218337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 614/1220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:56.223614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690a54-0520-4a00-b346-bbac0644400b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:56.224036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690a54-0520-4a00-b346-bbac0644400b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:56.224136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62690a54-0520-4a00-b346-bbac0644400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:56.242397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-62690a54-0520-4a00-b346-bbac0644400b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:56.244284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62690a54-0520-4a00-b346-bbac0644400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:56.309198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 607/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:56.585649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88145ce9-404d-4904-a8ab-4f07f2ad6b5a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:56.686584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88145ce9-404d-4904-a8ab-4f07f2ad6b5a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:56.720869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:56.721492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:56.721817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:56.722124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:56.732007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:29:56.738900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:56.740035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:56.740957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 615/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:29:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:56.744013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62690a54-0520-4a00-b346-bbac0644400b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:56.843385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62690a54-0520-4a00-b346-bbac0644400b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:56.867137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:56.877328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:56.877929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:56.878241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:56.878516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:56.879165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:56.879485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:56.881629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:56.889285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 608/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:29:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:56.895162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:56.938462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:56.992985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78f028-5465-433d-ac8e-42dbcd3f8a15 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.026525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.027138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.027420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.027694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.037324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.038791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:57.053361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:57.058791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:57.059799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:57.059799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:57.059799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:57.059799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 616/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:57.061374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.164083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc5c31-dcae-4c36-9d67-a5475ddefee9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.199032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.199631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.199939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.200228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.200845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:57.201143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.202537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.214181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 609/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:57.219858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.314988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:57.321569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58a3e-8787-475f-9984-6e68c687736c None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.354155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.354768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.355045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.355315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.362047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.363484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:29:57.374573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:57.375697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:57.376968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 617/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:57.382330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.428500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:57.479960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74d656-3664-4767-a656-4e1a515fadd5 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.513087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.513676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.513984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.514301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.515021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:57.515326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.516738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.533803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 610/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:57.539514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.638420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15724-5a60-423d-8caf-b34ebb090a70 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.671649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.672278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.672600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.672873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.687044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.687044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:57.700297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:57.701414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:57.702432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:57.702432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:57.702432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:57.702432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 618/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:57.707321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.808319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f955e8a-ce7f-4fcf-9628-85ea7d1e451a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.810661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:57.842555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.843157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.843436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.843707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.844343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:57.844643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:57.846035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:57.856997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 611/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:57.862771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:57.872661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:57.961079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ebc9-139d-4aa1-b41f-49762adbcedd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:57.993569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:57.994213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.994495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.997542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.001130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.002887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:29:58.014058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:58.014919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:58.015832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:29:58.018269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 619/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:58.020922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.120997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ef80-a080-474c-bf90-e39fe8264177 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.153295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.153883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.154191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.154474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.155146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:58.155444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.156861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace5a7-864c-461a-90c5-f35afc1d6165 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.168911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 612/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:58.174938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.241712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:58.275704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91008766-5684-4826-b49a-6c13c2366c86 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.308305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.308949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.309233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.309511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/86cdd101e8d840be856ace9511917a3b/roles/ec402292b0ee40a1ad657eb169b961bd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.323917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=86cdd101e8d840be856ace9511917a3b, role_id=ec402292b0ee40a1ad657eb169b961bd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.325362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcfe57-5b7c-4fe1-a02b-1a6678554f9a None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.451432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 620/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:29:58 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/86cdd101e8d840be856ace9511917a3b/roles/ec402292b0ee40a1ad657eb169b961bd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:30:00.324894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c101e8-03bd-42df-9fd8-52e4fa46c970 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.325546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c101e8-03bd-42df-9fd8-52e4fa46c970 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.325546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c101e8-03bd-42df-9fd8-52e4fa46c970 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.326828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 613/1233] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:00.332228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.332672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.332817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.351565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:00.352776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:00.418242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 621/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:00.686729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c101e8-03bd-42df-9fd8-52e4fa46c970 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:00.716269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:00.790386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c101e8-03bd-42df-9fd8-52e4fa46c970 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:00.827859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:00.828500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.828773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.829042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.839675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:00.844439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:00.845697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:00.846810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 614/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:00.851765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:00.898093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:00.950195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439a99-db32-4671-8177-d4d9b8108aaa None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:00.982644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:00.986473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:00.994425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 622/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:01.000264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.085887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:01.101363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a2d50-92c7-4cdc-b248-0a9cc1b1ed79 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:01.133540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:01.134176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:01.134453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:01.134722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:01.144758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:01.146233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:01.159831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:01.165262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:01.166488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:01.166488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:01.166488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:01.166488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 615/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:01.167327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.265757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4653c0-cf5a-46e8-a05e-d6b5c81b43eb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:01.274883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:01.298400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:01.300004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:01.300004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:01.300004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:01.300279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:01.300470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:01.302348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:01.313527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 623/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:01.320037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.421257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2cf42-8401-44cc-9699-0b546b644bfa None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:01.454830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:01.455444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:01.455721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:01.455992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:01.458646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:01.464176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:01.465605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:01.476283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:01.478760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:01.479950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 616/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:01.483347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.580568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de1f8-8810-40f9-b4aa-afd8ea64f5b3 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:01.612750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:01.613343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:01.613620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:01.613893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:01.615193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:01.615498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:01.616931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:01.634529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 624/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:01.640394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.740221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf074a5-7708-4796-9c79-555800a4290d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:01.772600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:01.773194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:01.773472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:01.773742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:01.833366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:01.839649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:01.842715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:01.937860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 617/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:01.943727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:01.970136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:02.040415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837205cc-50fa-46e4-9df9-27e59cb7a516 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.073194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.073802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.074123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.074410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.084694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.086113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:02.100144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:02.101749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:02.103070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:02.103070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:02.103070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:02.103070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 625/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:02.107509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.198535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:02.204039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624aceb-6773-4eb9-9094-4aa4f1f49057 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.237058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.237648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.237925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.238278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.238919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:02.239212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.240608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.251512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 618/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:02.257513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.335457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:02.357603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4b42-2bf0-4e0f-bf3a-0a946231fa7e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.390504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.391118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.391398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.391670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.398101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.399536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:02.410450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:02.412056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:02.413321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 626/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:02.418022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.517876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e5fc-7cef-4a8c-8648-0209097df3e4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.550777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.551365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.551648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.551917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.553283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:02.553587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.555037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e5af0-afb5-4968-9dc6-d8d88e57cf94 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.566529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 619/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:02.572650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.670790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d350890-70d2-45ad-a62e-bc784b140a90 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.704299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.704934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.705212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.705483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.706243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] RBAC: Adding query filter params (role.id=ec402292b0ee40a1ad657eb169b961bd, scope.project.id=f090099f7a4443abba863c4002872264, user.id=86cdd101e8d840be856ace9511917a3b) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:02.706553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.707979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b6781-bcde-4975-a3c0-b6eae1bb57bf None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.714279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 627/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/role_assignments?user.id=86cdd101e8d840be856ace9511917a3b&scope.project.id=f090099f7a4443abba863c4002872264&role.id=ec402292b0ee40a1ad657eb169b961bd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:04.714728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e390d-014b-4d6b-b938-6ecddffe6381 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:04.715185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e390d-014b-4d6b-b938-6ecddffe6381 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:04.715293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e390d-014b-4d6b-b938-6ecddffe6381 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:04.716707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 620/1247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:04.721824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:04.722261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:04.722414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:04.729178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:04.741819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:04.743056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:04.809697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 628/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:05.076667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e390d-014b-4d6b-b938-6ecddffe6381 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.095188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:05.175546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e390d-014b-4d6b-b938-6ecddffe6381 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:05.210413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:05.211035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:05.211316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:05.211585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:05.221235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:05.226525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:05.227661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:05.228813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 621/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:05.233629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.331226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e34e1-e459-4264-bed6-a35d81e0d6f1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:05.360967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:05.366068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445404db-72e6-4516-937e-a76c763391dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:05.366671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445404db-72e6-4516-937e-a76c763391dd None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:05.366953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445404db-72e6-4516-937e-a76c763391dd None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:05.367225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445404db-72e6-4516-937e-a76c763391dd None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:05.367890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445404db-72e6-4516-937e-a76c763391dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:05.368194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445404db-72e6-4516-937e-a76c763391dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:05.369599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445404db-72e6-4516-937e-a76c763391dd None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:05.378667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 629/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:05.384701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.462504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:05.484828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e47d-6a9a-42bb-8e34-c9df0d3a27a9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:05.517143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:05.517758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:05.518063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:05.518334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:05.529554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:05.531032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:05.545420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:05.554129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:05.555071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:05.555071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:05.555071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:05.555071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 622/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:05.555314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445404db-72e6-4516-937e-a76c763391dd None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.654289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445404db-72e6-4516-937e-a76c763391dd None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:05.688187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:05.688790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:05.689068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:05.689345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:05.690025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:05.690358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:05.691863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:05.703640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 630/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:05.709266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.809948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9cd1d-85b2-426a-bace-9ffadb727ed1 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:05.835861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:05.843680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:05.844296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:05.844574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:05.844845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:05.852659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:05.857976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:05.865055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:05.866172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:05.867266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 623/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:05.872068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:05.927174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:05.970688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feedeb-dd2c-4caa-b596-29a2e1c85e90 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.004618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.005209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.005593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.011759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.011759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:06.011759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.011759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.026269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 631/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:06.032366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.130871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7809a2d-8058-4c36-80d9-c430fc125e38 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.164863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.165458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.165736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.166036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.223987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.235886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.237333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.336097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 624/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:06.341928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.438455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292b441-c99a-4d17-825b-b58d2b644060 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.451742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.472522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.473176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.473448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.473717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.483437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.484850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:06.499047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:06.500155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:06.501245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:06.501245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:06.501245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:06.501245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 632/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:06.506741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.603570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.615694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112336-7e11-4285-ab6e-f5883f9a795f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.649395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.650015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.650297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.650637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.651239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:06.651538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.652939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.664705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 625/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:06.669858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.770463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890841-527b-4d1d-9c5f-69eec190bd8b None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.804335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.804963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.805245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.805520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.811987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.813431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:06.824524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:06.825638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:06.826876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 633/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:06.831624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.938148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b18bba-9f12-4036-8f0c-6bd3aa208cb0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.972161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.972759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.973036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.973309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.974031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:06.974377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:06.975801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd69f9-1b07-4421-9e65-c6d0616ddf9a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:06.987657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 626/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:06.993784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.020665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:07.093242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13687229-0387-48b3-bce2-d483872f7696 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.126729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.127313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.127593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.127867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.128588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=86cdd101e8d840be856ace9511917a3b) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:07.128895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.130406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b3111-4c1f-49e2-b337-1ca9f750c579 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.136438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 634/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/role_assignments?user.id=86cdd101e8d840be856ace9511917a3b&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:09.012904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184ade-71c0-477e-9a6e-f8be4d9d5342 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:09.013454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184ade-71c0-477e-9a6e-f8be4d9d5342 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:09.013454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96184ade-71c0-477e-9a6e-f8be4d9d5342 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:09.014777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 627/1261] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:09.019936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ad8c-ad58-4237-807b-189483702266 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:09.020337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ad8c-ad58-4237-807b-189483702266 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:09.020491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90ad8c-ad58-4237-807b-189483702266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:09.038536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-da90ad8c-ad58-4237-807b-189483702266 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:09.039718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-da90ad8c-ad58-4237-807b-189483702266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:09.105521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 635/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:09.372468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184ade-71c0-477e-9a6e-f8be4d9d5342 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:09.384290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:09.475831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96184ade-71c0-477e-9a6e-f8be4d9d5342 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:09.513988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:09.514627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:09.514903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:09.515173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:09.530678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:09.545597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:09.546703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:09.547629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:09.548266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 628/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:09.554304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90ad8c-ad58-4237-807b-189483702266 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:09.576075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:09.657885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90ad8c-ad58-4237-807b-189483702266 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:09.691382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:09.691978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:09.692263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:09.692537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:09.693403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:09.693507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:09.694914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:09.702844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 636/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:09.708678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:09.779650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:09.812003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de2836-341a-43b1-b406-b44b34b0d8a0 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:09.844624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:09.845239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:09.845514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:09.845786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:09.856127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:09.857560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:09.871635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:09.872780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:09.873759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:09.873759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:09.873759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:09.873759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 629/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:30:09.879066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:09.960804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:09.979741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c0bd-6303-4413-9ffb-b579f5789a4e None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.013577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.014209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.014491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.014766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.015411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:10.015715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.017088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.029402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 637/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:10.033870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.134122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b0c66-ee6e-493a-ae81-649b3f9a741a None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.153762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:10.168767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.170982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.170982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.170982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.177264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.179429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:10.190175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:10.191306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:10.192257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 630/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:10.197172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.296390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26761362-1e13-4edc-bf8c-b2982ecdb57d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.329284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.329879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.330190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.330496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.331194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:10.331499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.332923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.342956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:10.351530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 638/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:10.357370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.458845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5759-5778-4b80-bc1c-b7c97900f12d None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.492098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.492713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.493010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.493296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.503771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.505192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:10.519631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:10.520749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:10.521981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:10.521981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:10.521981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:10.521981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 631/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:10.526568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.623971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45efba6-eabd-4cb1-a296-3da2a48e28ba None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.660613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.661228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.661504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.661787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.663054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:10.663354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.664703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.675671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 639/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:10.681422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.713985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:10.781252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7887c3-4218-4588-b2ff-b9ee8b3b50d8 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.815742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.816353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.816658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.816925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.823977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.825578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:10.840823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:10.841722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:10.842733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 632/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:10.847892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:10.905860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:10.948112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc6a2-fd63-4e46-ae86-29ca91c6348d None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:10.982554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:10.983147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.983428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.983702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.984392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:10.984698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:10.986147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5d42e-dccb-45d1-8998-ddf6e56acf9f None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:10.997870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 640/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:11.003991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:11.096203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:11.104620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceeac-f4fa-4a80-b775-b033367b3ec4 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:11.137702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:11.138375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:11.138657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:11.138932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] PATH_INFO: `/v3/projects/f090099f7a4443abba863c4002872264/users/86cdd101e8d840be856ace9511917a3b/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:11.140797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] RBAC: Authorizing `identity:create_grant(project_id=f090099f7a4443abba863c4002872264, user_id=86cdd101e8d840be856ace9511917a3b, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:11.142256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31ba7a-8e04-465f-a977-587ef4da540d None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:11.223334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 633/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 24 03:30:11 2022] PUT /identity/v3/projects/f090099f7a4443abba863c4002872264/users/86cdd101e8d840be856ace9511917a3b/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:30:13.137863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831ecc-0fa7-44f7-927a-cda6c665eb29 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.145152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831ecc-0fa7-44f7-927a-cda6c665eb29 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.145152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831ecc-0fa7-44f7-927a-cda6c665eb29 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.145152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 641/1274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:13.145423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.145423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.145876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.164450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:13.165669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:13.230035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 634/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:13.503224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831ecc-0fa7-44f7-927a-cda6c665eb29 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:13.606312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831ecc-0fa7-44f7-927a-cda6c665eb29 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:13.623232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:13.640992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:13.641626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.641910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.642218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.654381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:13.659083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:13.660199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:13.661239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:13.665957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 642/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:13.666907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:13.769308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:13.794310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d2ef-32a1-437d-bd1c-e9898d90f8ad None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:13.837701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:13.838369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.838751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.839015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.839677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:13.839977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:13.841384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:13.852039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 635/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:13.858358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:13.972140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cfc3-e8af-4cd8-b40d-334c95c4bc56 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.011316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.012043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.012429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.012815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.033501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:14.033501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:14.060513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:14.066168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:14.067352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:14.067352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:14.067352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:14.067352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 643/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:14.068010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:14.171617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29bfe9-8e05-4c3c-8fd4-968ed716694f None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.205705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.205886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.209181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.209181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.209181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:14.209181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:14.209181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:14.221031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 636/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:14.227332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:14.258513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.325092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68f77-6c23-47a8-a0a9-49aee69258fa None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.359340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.359958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.360237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.360510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.367848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:14.369279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:14.380723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:14.381810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:14.383128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 644/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:14.388096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:14.392131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.486022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49ee1-a9e0-4ebb-afbe-30cec49155a7 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.519375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.519968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.520255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.520527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.521244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:14.521549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:14.523008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:14.540258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 637/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:14.546089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:14.638209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.648426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2653a4-4f5a-4f81-8e4a-cc7f143a3cfc None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.683767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.684400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.684648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.684917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:14.750753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:14.752190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:14.842651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.849165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 645/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:14.855114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:14.916608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:14.961667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15045-8b1e-4aa4-a69e-7b6f85766c0c None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:14.997650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:14.998386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:14.998710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:14.999024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.010274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.011798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:15.025918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:15.027011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:15.028272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:15.028272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:15.028272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:15.028272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 638/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:15.032823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.130470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1da75-0a1d-4fdf-bc0a-94e6f4fea415 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.164577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.165208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.165523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.165797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.166457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:15.166807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.168127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.179707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 646/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:15.185429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.286130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcbda0-8dcf-4701-a8f4-9a4fe2386fd9 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.300342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:15.322823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.323461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.323743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.324024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.330697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.332138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:15.343600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:15.344673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: ERROR keystone.server.flask.application Aug 24 03:30:15.345815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 639/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:15.350697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.401832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:15.450310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4432-f94d-4e33-b70c-5a5869777167 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.482660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.483248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.483525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.483791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.484468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:15.484763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.486302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55911ba5-be5e-4041-9625-71d218838b09 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.497995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 647/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:15.504049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.604950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2232-f406-40de-93cf-5c3b3bea4286 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.639018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.639609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.639889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.640162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.640950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] RBAC: Adding query filter params (role.id=15131bc73ffe4de98028e781cae256f3, scope.project.id=f090099f7a4443abba863c4002872264, user.id=86cdd101e8d840be856ace9511917a3b) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:15.641203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.642647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfe80b-7142-4eb7-b8a8-981cd44352d1 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.648303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 640/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/role_assignments?user.id=86cdd101e8d840be856ace9511917a3b&scope.project.id=f090099f7a4443abba863c4002872264&role.id=15131bc73ffe4de98028e781cae256f3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:17.584840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f130-98e0-471d-b3c7-0e58f9d51f89 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:17.585886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f130-98e0-471d-b3c7-0e58f9d51f89 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:17.585886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8f130-98e0-471d-b3c7-0e58f9d51f89 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:17.587290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 648/1288] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:17.592936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:17.593368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:17.593644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:17.611483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:17.612788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:17.642587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.678893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 641/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:17.947819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8f130-98e0-471d-b3c7-0e58f9d51f89 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:18.048980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8f130-98e0-471d-b3c7-0e58f9d51f89 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:18.060177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:18.082992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:18.083611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:18.083894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:18.084188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:18.084784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:18.086698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:18.095156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:18.104978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:18.105924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 649/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:18.106857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:18.201770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277edae-82e3-4f40-8200-f286c15c2439 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:18.236757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:18.237344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:18.237640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:18.237898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:18.238554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:18.238852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:18.240219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6f7c9-b076-4760-a553-cbc88194e132 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:18.244947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 642/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:18.250866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:18.349848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d7d97-5497-4594-9118-c8a67ede9862 None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:18.384271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:18.384886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:18.385167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:18.385443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] PATH_INFO: `/v3/services` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:18.386109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:18.386416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:18.387786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b5e20-f42a-4ea7-a770-86d0b8a7ed83 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:18.392319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 650/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:20.358635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aab19-e62c-452d-83b8-200199f644f5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.359177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aab19-e62c-452d-83b8-200199f644f5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.359177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aab19-e62c-452d-83b8-200199f644f5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.360553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 643/1293] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:20.368953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5911-986f-4ff8-a77c-b798e17404de None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.371444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5911-986f-4ff8-a77c-b798e17404de None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.371749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c5911-986f-4ff8-a77c-b798e17404de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.395034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b45c5911-986f-4ff8-a77c-b798e17404de None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:20.396746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b45c5911-986f-4ff8-a77c-b798e17404de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:20.436915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.474459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 651/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:20.745602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aab19-e62c-452d-83b8-200199f644f5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.777281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.846855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aab19-e62c-452d-83b8-200199f644f5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.879614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.880237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.880515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.880786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.881508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.883804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff79d-e21f-4fde-b6da-091660b1a700 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.014652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 644/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 24 03:30:20 2022] POST /identity/v3/services => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:30:22.964210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8216-4569-4c02-945c-b75c303696b2 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:22.964715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8216-4569-4c02-945c-b75c303696b2 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:22.964715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8216-4569-4c02-945c-b75c303696b2 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:22.966111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 652/1296] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:22.971339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:22.971723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:22.971896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:22.990069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:22.991266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:23.064788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 645/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:23.332140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8216-4569-4c02-945c-b75c303696b2 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:23.433533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8216-4569-4c02-945c-b75c303696b2 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:23.466942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:23.467558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.467836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.468104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.468682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:23.470108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:23.479220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:23.482168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:23.483226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 653/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:23.486631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:23.505830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.584810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda328a-68e8-420e-9363-c0a593508521 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:23.619090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:23.619685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.619963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.620233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.620856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:23.621160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:23.622545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:23.627537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 646/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:23.633917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:23.665100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.732805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d8c99-1dc8-47c0-911d-e605ee7482bb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:23.765470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:23.766103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.766384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.766652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.767346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] RBAC: Adding query filter params (interface=public, service_id=e4cd854af2a54aa5909e0459d7a402f8, region_id=RegionOne) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:23.767650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:23.769001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648708ba-9b00-4eb3-8fd8-5502db85fcd8 None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:23.774687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 654/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 24 03:30:23 2022] GET /identity/v3/endpoints?service_id=e4cd854af2a54aa5909e0459d7a402f8&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:23.780477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:23.862561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.879918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee0d8-fd56-457f-82f1-d5d3c555f867 None admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:23.912596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:23.913187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.913467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.914324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.915635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:23.916276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339f4d7-9d04-43cc-9998-6a65d3820c3c None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:23.922934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 647/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 24 03:30:23 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:30:25.833927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c48f3-a73c-420e-9705-1d83f35c27bc None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:25.834486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c48f3-a73c-420e-9705-1d83f35c27bc None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:25.834486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c48f3-a73c-420e-9705-1d83f35c27bc None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:25.836143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 655/1302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:25.841178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:25.841602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:25.841740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:25.862810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:25.864047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:25.930266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 648/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:26.200673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c48f3-a73c-420e-9705-1d83f35c27bc None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:26.299299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:26.306080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c48f3-a73c-420e-9705-1d83f35c27bc None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:26.338831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:26.339454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:26.339730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:26.339999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:26.340626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:26.342019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:26.350376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:26.352105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: ERROR keystone.server.flask.application Aug 24 03:30:26.352936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 656/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:26.358190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:26.433815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:26.456036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fc70a-9ec0-4694-b20d-58a93b4dd07b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:26.493915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:26.494546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:26.494821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:26.495089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] PATH_INFO: `/v3/services` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:26.495717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:26.501595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:26.502987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381b43-29f2-4d40-8fde-4c2ba7ccd8f8 None admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:26.509300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 649/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:26.515496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:26.618147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5278ae-79cf-4876-8683-efaa7b0ba4bb None admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:26.651486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:26.652084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:26.652401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:26.652672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:26.653317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:26.654710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f36aec-92ff-4d65-bda5-acc18f8b645e None admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:26.746894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 657/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:30:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:30:36.511199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=30 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.741455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:51.620132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b15e-5c05-4d9a-95da-b09d141dd4ca None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:51.620561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b15e-5c05-4d9a-95da-b09d141dd4ca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:51.620666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b15e-5c05-4d9a-95da-b09d141dd4ca None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:51.626877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 650/1307] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:37:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:37:51.635608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213066d-83bd-4086-81de-0997cbffa115 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:51.637322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213066d-83bd-4086-81de-0997cbffa115 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:51.638087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213066d-83bd-4086-81de-0997cbffa115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:51.762694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1213066d-83bd-4086-81de-0997cbffa115 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:51.762694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1213066d-83bd-4086-81de-0997cbffa115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:51.928308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 658/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:52.235172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:52.235452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:52.235884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:52.237350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 651/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 24 03:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:37:52.243564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df933-0d67-47f2-ab20-9457be2e8baa None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:52.243857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df933-0d67-47f2-ab20-9457be2e8baa None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:52.244139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df933-0d67-47f2-ab20-9457be2e8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:52.322385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-010df933-0d67-47f2-ab20-9457be2e8baa None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:52.323588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-010df933-0d67-47f2-ab20-9457be2e8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:52.345669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:52.412655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 659/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 24 03:37:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:52.422390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:52.424403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:52.552985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0bbac-9f71-4deb-a16c-6eb5cb09921e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:52.634763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:52.635407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:52.635680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:52.635892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:52.637517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:52.700826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:52.772505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:52.773966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3020c-9ccb-4a36-af97-d22e7d9f31f2 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:52.795659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 652/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:37:54.990953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:54.991462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:54.991462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:54.992985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 660/1312] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:37:54.998717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6082e2-e09e-4e28-98aa-a41ee37d6d44 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:54.999106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6082e2-e09e-4e28-98aa-a41ee37d6d44 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:54.999277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6082e2-e09e-4e28-98aa-a41ee37d6d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:55.086411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de6082e2-e09e-4e28-98aa-a41ee37d6d44 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:55.087608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de6082e2-e09e-4e28-98aa-a41ee37d6d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:55.187242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 653/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:55.471136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:55.472675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:55.575402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb7e77-2178-4881-a149-96cc70094da8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:55.645411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:55.647759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:55.648380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:55.648662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:55.648933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:55.650591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:55.759025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:55.760392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11d3c8-20f2-4533-bd41-1ecb81282dcc service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:55.779292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 661/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:37:58.352146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:58.352675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:58.352790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:58.354130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 654/1315] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:37:58.359392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29377-a8e5-4360-9044-4b981b73a96d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:58.359805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29377-a8e5-4360-9044-4b981b73a96d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:58.359941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef29377-a8e5-4360-9044-4b981b73a96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:58.426780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cef29377-a8e5-4360-9044-4b981b73a96d None None] MFA Rules not processed for user `baba34fbf9cc4c40bf5ef26c24eba641`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:37:58.427986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cef29377-a8e5-4360-9044-4b981b73a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:58.486349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:58.532001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 662/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:37:58.814506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:37:58.816045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:58.826416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:58.920948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8613c-1d67-4125-90d3-e4f8d4f6632f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:37:58.991870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:37:58.992410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:37:58.992689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:37:58.992961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:37:58.994586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:37:59.056827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:59.103225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:37:59.104656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36987da-2ab6-4894-9614-962949f49997 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:37:59.123288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 655/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:37:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:01.869119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:01.869676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:01.869676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:01.871064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 663/1318] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:01.876870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50db5-7a76-4008-8efb-feffeaa55c89 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:01.877259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50db5-7a76-4008-8efb-feffeaa55c89 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:01.877421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50db5-7a76-4008-8efb-feffeaa55c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:01.952544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d1d50db5-7a76-4008-8efb-feffeaa55c89 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:01.953665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d1d50db5-7a76-4008-8efb-feffeaa55c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:02.047340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 656/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:02.333481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:02.335054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:02.436605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67736fc-22f6-46c6-be3b-ce96adb58f60 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:02.508461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:02.509059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:02.509340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:02.509614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:02.511263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:02.519044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:02.621954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:02.623420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bac4d-9ca4-470a-9f07-37f56af480c1 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:02.642084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 664/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:05.582590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:05.583106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:05.583106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:05.584426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 657/1321] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:05.589642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b61-8249-4a25-9670-c97a081dc397 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:05.590589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b61-8249-4a25-9670-c97a081dc397 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:05.590819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b61-8249-4a25-9670-c97a081dc397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:05.657081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ad4c7b61-8249-4a25-9670-c97a081dc397 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:05.658312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ad4c7b61-8249-4a25-9670-c97a081dc397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:05.721109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:05.760306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 665/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:06.045564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:06.047279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:06.068980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:06.156911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3209d-ba40-446d-a286-13f1b012d1d2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:06.229827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:06.230470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:06.231247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:06.231522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:06.233129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:06.305622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:06.344295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:06.345790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed2e3-2eea-4058-a0f3-0f917acb4fb0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:06.364051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 658/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:08.320602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:08.321131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:08.321131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:08.322544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 666/1324] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:08.328750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66051-53cd-49d1-93a2-9f0f056d2e03 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:08.329221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66051-53cd-49d1-93a2-9f0f056d2e03 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:08.329314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66051-53cd-49d1-93a2-9f0f056d2e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:08.399392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2cb66051-53cd-49d1-93a2-9f0f056d2e03 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:08.400618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2cb66051-53cd-49d1-93a2-9f0f056d2e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:08.497747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 659/1325] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:08.781427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:08.783048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:08.894374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63428ed3-c7c3-4a8d-a39d-64008a365c43 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:08.973399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:08.974026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:08.974297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:08.974565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:08.976185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:08.993861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:09.100797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:09.102252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f19ea-3818-4b92-a6c1-69af3c55a4a2 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:09.121240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 667/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:11.096786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:11.097289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:11.097289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:11.098714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 660/1327] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:11.104135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d33f-89ac-4342-9a35-6793520a3d9b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:11.104518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d33f-89ac-4342-9a35-6793520a3d9b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:11.104807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d33f-89ac-4342-9a35-6793520a3d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:11.170783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a767d33f-89ac-4342-9a35-6793520a3d9b None None] MFA Rules not processed for user `baba34fbf9cc4c40bf5ef26c24eba641`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:11.171988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a767d33f-89ac-4342-9a35-6793520a3d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:11.240350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:11.272913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 668/1328] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:11.562814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:11.564457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:11.597663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:11.684591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68592ed-468e-4b05-a638-a3edd1f5b88f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:11.772385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:11.773085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:11.773440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:11.773781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:11.775536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:11.856392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:11.887626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:11.889656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edeffb-51d5-40e4-ba2d-3eeb3da941e9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:11.907513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 661/1329] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:14.304595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:14.305147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:14.305147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:14.306587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 669/1330] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:14.312664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a90fd-c02e-4e83-9a56-0b03429a5320 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:14.313082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a90fd-c02e-4e83-9a56-0b03429a5320 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:14.313209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a90fd-c02e-4e83-9a56-0b03429a5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:14.378861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-317a90fd-c02e-4e83-9a56-0b03429a5320 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:14.380103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-317a90fd-c02e-4e83-9a56-0b03429a5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:14.474386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 662/1331] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:14.761467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:14.763650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:14.864170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f76b-5666-4aca-b849-fa1840e9adbc None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:14.937313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:14.937906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:14.938212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:14.938474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:14.940052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:14.968145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:15.049580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:15.051133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8146c-9417-453f-acc5-884556dbe8ee service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:15.069419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 670/1332] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:17.024233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e2d9-3fd4-428f-becd-4716cc9f4747 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:17.024786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e2d9-3fd4-428f-becd-4716cc9f4747 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:17.024786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e2d9-3fd4-428f-becd-4716cc9f4747 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:17.026082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 663/1333] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:17.031761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff08d0-63fd-448f-94ad-707ec276f83c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:17.032249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff08d0-63fd-448f-94ad-707ec276f83c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:17.032396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff08d0-63fd-448f-94ad-707ec276f83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:17.098175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-36ff08d0-63fd-448f-94ad-707ec276f83c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:17.099379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-36ff08d0-63fd-448f-94ad-707ec276f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:17.173282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:17.195266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 671/1334] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:17.498855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:17.499172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:17.499453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:17.500807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 664/1335] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 24 03:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:17.506783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f3d1-79c9-4995-a545-daf4433f6a6e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:17.507163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f3d1-79c9-4995-a545-daf4433f6a6e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:17.507444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f3d1-79c9-4995-a545-daf4433f6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:17.585504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0764f3d1-79c9-4995-a545-daf4433f6a6e None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:17.586787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0764f3d1-79c9-4995-a545-daf4433f6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:17.661495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 672/1336] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 24 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:17.671120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:17.672656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:17.712252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:17.787778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef4ef3-80e5-45f7-bcab-2bf1af9303f2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:17.859833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:17.860435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:17.860714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:17.860985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:17.862623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:17.944793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:17.970654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:17.972095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5bad5-2c67-49dd-9dfa-cf0f8953cc84 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:17.990755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 665/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:21.327800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa631a-1704-460f-9936-50a516073dab None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:21.328346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa631a-1704-460f-9936-50a516073dab None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:21.328346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa631a-1704-460f-9936-50a516073dab None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:21.329710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 673/1338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:21.334951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2a1b-99d0-48e7-9793-4487903f1e71 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:21.335369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2a1b-99d0-48e7-9793-4487903f1e71 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:21.335534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2a1b-99d0-48e7-9793-4487903f1e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:21.400590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8d3b2a1b-99d0-48e7-9793-4487903f1e71 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:21.401776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8d3b2a1b-99d0-48e7-9793-4487903f1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:21.504865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 666/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:21.801459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa631a-1704-460f-9936-50a516073dab None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:21.803035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-92aa631a-1704-460f-9936-50a516073dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:21.879230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:21.906933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa631a-1704-460f-9936-50a516073dab None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:21.978418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:21.979021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:21.979297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:21.979566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:21.981765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:22.093232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:22.094714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4192d57-334b-4b98-afa9-9f845b751c2a service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:22.113737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 674/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:26.396225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:26.397058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:26.397058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:26.398156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 667/1341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:26.404326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916255a-83ac-48af-84a5-1a74e3f9fe73 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:26.404777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916255a-83ac-48af-84a5-1a74e3f9fe73 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:26.404866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916255a-83ac-48af-84a5-1a74e3f9fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:26.410417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:26.473546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e916255a-83ac-48af-84a5-1a74e3f9fe73 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:26.474818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e916255a-83ac-48af-84a5-1a74e3f9fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:26.574040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 675/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:26.859517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:26.861043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:26.911107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:26.968658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310d5a-a9b7-44d8-a407-7ece4befd2ef None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:27.042178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:27.042833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:27.043110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:27.043380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:27.045468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:27.144996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:27.161560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:27.163157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc0ea1-6310-4dc4-81ea-2ea0060dd426 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:27.181762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 668/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:30.253953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:30.254462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:30.254462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:30.255773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 676/1344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:30.260946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065060-d3c8-435e-a402-5fb4c332bed4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:30.261341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065060-d3c8-435e-a402-5fb4c332bed4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:30.261622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065060-d3c8-435e-a402-5fb4c332bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:30.328129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e1065060-d3c8-435e-a402-5fb4c332bed4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:30.329342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e1065060-d3c8-435e-a402-5fb4c332bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:30.427885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 669/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:30.715236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:30.717419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:30.805452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:30.822454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a86d-ad5c-4bab-b2c0-4ff7b567150f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:30.898991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:30.899618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:30.899919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:30.900185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:30.901800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:31.016806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:31.018300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2162-08e6-428f-86e6-b67a73f3988c service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:31.037517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 677/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:35.560270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:35.560712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:35.560801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:35.562203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 670/1347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:35.567814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6323c-ad11-4d30-90a3-087ca9cdeaf6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:35.568328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6323c-ad11-4d30-90a3-087ca9cdeaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:35.568426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6323c-ad11-4d30-90a3-087ca9cdeaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:35.584294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:35.640274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e5f6323c-ad11-4d30-90a3-087ca9cdeaf6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:35.641493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e5f6323c-ad11-4d30-90a3-087ca9cdeaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:35.744922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 678/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:36.027691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:36.029356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:36.092095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:36.138883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9038bd-b9d1-48e1-9209-2e410414ca1c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:36.210332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:36.210938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:36.211250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:36.211556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:36.213194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:36.317654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:36.321046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:36.322557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306bb0c-5a25-4ed7-bd5d-40859aed00a7 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:36.340641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 671/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:41.241814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab48b9-adba-40b1-a3fb-41e42965abfc None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:41.241814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab48b9-adba-40b1-a3fb-41e42965abfc None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:41.241814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab48b9-adba-40b1-a3fb-41e42965abfc None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:41.241814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 679/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:41.248303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c24f3-fde6-481d-961f-1a26aea3355f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:41.248303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c24f3-fde6-481d-961f-1a26aea3355f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:41.248303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c24f3-fde6-481d-961f-1a26aea3355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:41.338388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c18c24f3-fde6-481d-961f-1a26aea3355f None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:41.339588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c18c24f3-fde6-481d-961f-1a26aea3355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:41.505806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 672/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:45.743210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=59 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:45.769171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d27194-5b66-40c4-a722-ee6b63d3ef81 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:45.769472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d27194-5b66-40c4-a722-ee6b63d3ef81 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:45.769823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d27194-5b66-40c4-a722-ee6b63d3ef81 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:45.771649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 680/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:45.776654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9135c-c825-4d45-b62e-2e35cebc5ed9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:45.777145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9135c-c825-4d45-b62e-2e35cebc5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:45.777415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9135c-c825-4d45-b62e-2e35cebc5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:45.836207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:45.860951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-85f9135c-c825-4d45-b62e-2e35cebc5ed9 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:45.862209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-85f9135c-c825-4d45-b62e-2e35cebc5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:45.987616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 673/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:38:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:47.286973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393566c-55be-48f5-b456-67e4f04fdb6c None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:47.287968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393566c-55be-48f5-b456-67e4f04fdb6c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:47.288312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393566c-55be-48f5-b456-67e4f04fdb6c None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:47.289929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 681/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:38:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:47.295763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d711-006e-475f-8369-c51973bb9373 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:47.296181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d711-006e-475f-8369-c51973bb9373 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:47.296340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5d711-006e-475f-8369-c51973bb9373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:47.375715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f2e5d711-006e-475f-8369-c51973bb9373 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:47.376946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2e5d711-006e-475f-8369-c51973bb9373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:47.418737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:47.484325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 674/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:50.857476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea79d3-51e5-41a8-8923-c0c0e9462ebb None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:50.860390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea79d3-51e5-41a8-8923-c0c0e9462ebb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:50.860390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea79d3-51e5-41a8-8923-c0c0e9462ebb None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:50.860390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 682/1356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:50.865151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de467-bb14-41c2-856c-8f9450335270 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:50.865957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de467-bb14-41c2-856c-8f9450335270 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:50.866276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de467-bb14-41c2-856c-8f9450335270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:50.944353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-208de467-bb14-41c2-856c-8f9450335270 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:50.945460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-208de467-bb14-41c2-856c-8f9450335270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:51.066618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 675/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:38:51.375263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:51.375847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:51.376431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:51.378385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 683/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 03:38:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:51.387031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef481-6bc3-4e0b-bf27-196e5223c442 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:51.394005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef481-6bc3-4e0b-bf27-196e5223c442 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:51.394005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef481-6bc3-4e0b-bf27-196e5223c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:51.406748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:51.471877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-76aef481-6bc3-4e0b-bf27-196e5223c442 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:51.473309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-76aef481-6bc3-4e0b-bf27-196e5223c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:51.599040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 676/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:51.608120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:51.609890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:51.781310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3d7a-8f79-4bae-8870-c9b0846b7b09 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:51.874186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:51.915922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:51.916515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:51.916788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:51.917058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:51.918726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:52.008795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:52.010414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3fd1c-7ed8-4acd-be8a-da6782bcee38 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:52.032349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 684/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:54.187564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:54.188008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:54.188008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:54.189599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 677/1361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:54.194926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b169-4af2-4ed3-89e0-238d594dd06b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:54.195327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b169-4af2-4ed3-89e0-238d594dd06b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:54.195672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128b169-4af2-4ed3-89e0-238d594dd06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:54.268248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3128b169-4af2-4ed3-89e0-238d594dd06b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:54.269347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3128b169-4af2-4ed3-89e0-238d594dd06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:54.308470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:54.374984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 685/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:54.665468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:54.667073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:54.742586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:54.831494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843909e-7550-4235-8e6c-7629a65eccb8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:54.955598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36628b36-1872-4457-9759-793731a86944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:54.956205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628b36-1872-4457-9759-793731a86944 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:54.956482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628b36-1872-4457-9759-793731a86944 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:54.956751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628b36-1872-4457-9759-793731a86944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:54.958428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-36628b36-1872-4457-9759-793731a86944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:54.985075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:55.055759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36628b36-1872-4457-9759-793731a86944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:55.057279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36628b36-1872-4457-9759-793731a86944 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:55.078210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 678/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:57.428953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442678d-294f-4e43-a551-a95dcaa5b2ca None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:57.429488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442678d-294f-4e43-a551-a95dcaa5b2ca None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:57.429488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442678d-294f-4e43-a551-a95dcaa5b2ca None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:57.430825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 686/1364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:57.436832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ddfed-45bf-4d88-b749-9dbe0cfa2b67 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:57.437242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ddfed-45bf-4d88-b749-9dbe0cfa2b67 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:57.437392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ddfed-45bf-4d88-b749-9dbe0cfa2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:57.509409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1e7ddfed-45bf-4d88-b749-9dbe0cfa2b67 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:57.510687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1e7ddfed-45bf-4d88-b749-9dbe0cfa2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:57.612669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:57.615934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 679/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:57.929407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:57.930035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:57.930381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:57.932131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 687/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 03:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:57.943137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9336a-7fdd-4daf-afc9-bcd605a1f52e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:57.943421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9336a-7fdd-4daf-afc9-bcd605a1f52e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:57.944002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9336a-7fdd-4daf-afc9-bcd605a1f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:58.023533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7ef9336a-7fdd-4daf-afc9-bcd605a1f52e None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:58.024730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7ef9336a-7fdd-4daf-afc9-bcd605a1f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:58.150388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 680/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:58.158759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:38:58.160386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:58.314560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd19add-d8da-4f4e-8d58-ffc13d631eba None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:38:58.338635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:58.439117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:38:58.440165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:58.440671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:58.441196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:58.443065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:58.540621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:38:58.542305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28eb9-d740-43ed-9abf-cbae2e0e6a16 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:38:58.561187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 688/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:38:59.172060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa6-3fc8-4b27-ae2b-db86cf198ac6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:59.172583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa6-3fc8-4b27-ae2b-db86cf198ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:59.172583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe36aa6-3fc8-4b27-ae2b-db86cf198ac6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:59.174057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 681/1369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:59.179457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efde-b08b-431b-9202-17856d2003df None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:59.179746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efde-b08b-431b-9202-17856d2003df None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:59.180019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efde-b08b-431b-9202-17856d2003df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:59.213396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:59.249550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-46d3efde-b08b-431b-9202-17856d2003df None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:38:59.250784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-46d3efde-b08b-431b-9202-17856d2003df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:38:59.354358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 689/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:38:59.940145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:59.940145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:59.940145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:38:59.942511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 682/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 24 03:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:38:59.946427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aece68-d9b2-49c9-ba2e-7a5bd92d6c1e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:38:59.946931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aece68-d9b2-49c9-ba2e-7a5bd92d6c1e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:38:59.947093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aece68-d9b2-49c9-ba2e-7a5bd92d6c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:00.036128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a6aece68-d9b2-49c9-ba2e-7a5bd92d6c1e None None] MFA Rules not processed for user `634e36d89a344c1a87946891dbdbbfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:00.037349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a6aece68-d9b2-49c9-ba2e-7a5bd92d6c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:00.084507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:00.114727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 690/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 24 03:38:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:00.122234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:00.123837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:00.176918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:00.236431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b0a7-e14d-4a23-9f24-20929f0d46e6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:00.322778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:00.323562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:00.323936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:00.324384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:00.326760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:00.428455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:00.442559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:00.444168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4053f1-a0a5-46cb-9998-9f29be4c0bf9 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:00.469785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 683/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:00.802220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:00.802518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:00.802802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:00.811236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 691/1374] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:00.816316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda335b-38dc-4659-aeb4-d7ba65a33f47 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:00.816608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda335b-38dc-4659-aeb4-d7ba65a33f47 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:00.817157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda335b-38dc-4659-aeb4-d7ba65a33f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:00.883763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bdda335b-38dc-4659-aeb4-d7ba65a33f47 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:00.884976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bdda335b-38dc-4659-aeb4-d7ba65a33f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:00.981753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 684/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:01.268258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:01.269791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:01.415891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e796d0-5e32-40c7-a8a1-b7ca54918768 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:01.467151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:01.528461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:01.528998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:01.529900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:01.530201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:01.531814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:01.621170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:01.622808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7146ce-2957-40a6-8058-61d91f036819 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:01.641396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 692/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:03.755122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:03.755638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:03.755755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:03.757513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:03.764070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b08d5-9272-4589-b449-52c95d99216a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:03.764911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b08d5-9272-4589-b449-52c95d99216a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:03.765350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b08d5-9272-4589-b449-52c95d99216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:03.841991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-122b08d5-9272-4589-b449-52c95d99216a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:03.843094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-122b08d5-9272-4589-b449-52c95d99216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:03.850346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:03.943992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 693/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:04.247110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:04.249078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:04.314222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:04.412999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde479e-15fb-4aaf-8d26-c01edeec0d72 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:04.536854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:04.537464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:04.537747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:04.538046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:04.539670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:04.559361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:04.638814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:04.640440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ab651-91dd-4374-886d-1765353bbb7c service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:04.669057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 686/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:06.792866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:06.793388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:06.793388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:06.794889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 694/1380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:06.800173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee61e0-b2e6-4227-a261-6ca11ca73c6d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:06.800565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee61e0-b2e6-4227-a261-6ca11ca73c6d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:06.800749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee61e0-b2e6-4227-a261-6ca11ca73c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:06.872757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-43ee61e0-b2e6-4227-a261-6ca11ca73c6d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:06.874187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-43ee61e0-b2e6-4227-a261-6ca11ca73c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:06.973661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:06.984627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 687/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:07.278600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:07.280760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:07.427984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.439034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b090e-f281-460f-a45a-6aacd03816f7 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:07.561206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:07.561818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:07.562127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:07.562421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:07.564153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:07.664461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:07.666107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474616d3-0c5a-4f7a-896d-31207c67be80 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:07.679950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:07.696142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 695/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:10.196329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:10.196878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:10.196878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:10.198279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 688/1383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:10.203786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a124-b9ab-47b5-bbc8-127cd3a8eae0 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:10.204682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a124-b9ab-47b5-bbc8-127cd3a8eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:10.204682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a124-b9ab-47b5-bbc8-127cd3a8eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:10.276718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c731a124-b9ab-47b5-bbc8-127cd3a8eae0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:10.278022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c731a124-b9ab-47b5-bbc8-127cd3a8eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:10.399198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 696/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:10.692524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:10.694160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:10.871150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf357b-f7a4-4619-936e-594a0d0bad05 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:10.940565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:10.992380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:10.993016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:10.993312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:10.993606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:10.995369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:11.087478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:11.089181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca20656-59c6-4913-b26e-77e9dbc32d20 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:11.114179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 689/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:13.030239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:13.030788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:13.030788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:13.032959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 697/1386] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:13.038942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2699e9-f210-4ef7-b6cd-e9e50ecc7072 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:13.043987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2699e9-f210-4ef7-b6cd-e9e50ecc7072 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:13.043987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2699e9-f210-4ef7-b6cd-e9e50ecc7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:13.115984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ea2699e9-f210-4ef7-b6cd-e9e50ecc7072 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:13.117216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ea2699e9-f210-4ef7-b6cd-e9e50ecc7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:13.149698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:13.283903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:13.523177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:13.524718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:13.621427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:13.698805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb21bb8-dc4f-4100-a06b-d79c32ce8e63 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:13.816251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:13.816879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:13.817174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:13.817460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:13.819175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:13.859116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:13.911461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:13.912958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d791-fc29-40ed-8ba2-4f13f9095515 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:13.931644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:16.116661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf156-25be-49dd-9dc6-ca992142385d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.116661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf156-25be-49dd-9dc6-ca992142385d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.116661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf156-25be-49dd-9dc6-ca992142385d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.116661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 691/1389] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:16.122014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.122425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.122599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.191541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:16.192770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.226150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328799-6a19-4c28-83a2-2a1cf8b4e25b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.226434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328799-6a19-4c28-83a2-2a1cf8b4e25b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.226705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328799-6a19-4c28-83a2-2a1cf8b4e25b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.228049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 692/1390] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:16.233102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b93b3-c3d0-4597-9027-ea03471f0685 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.233385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b93b3-c3d0-4597-9027-ea03471f0685 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.233663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b93b3-c3d0-4597-9027-ea03471f0685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.302634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9e5b93b3-c3d0-4597-9027-ea03471f0685 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:16.303856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9e5b93b3-c3d0-4597-9027-ea03471f0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.307931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 699/1391] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:16.401557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 693/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:16.602764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:16.603977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.618207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:16.704563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89ab3-c431-4372-8a61-b2b456994f68 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.704930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89ab3-c431-4372-8a61-b2b456994f68 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.705134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89ab3-c431-4372-8a61-b2b456994f68 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.706530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 694/1393] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 24 03:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:39:16.711446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.711814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.712100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.726497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98e1e-021c-4e81-b674-898332f4d8c5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:16.727860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:16.791703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] MFA Rules not processed for user `f7039ec3afcd41b7b006d1179e19cbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:16.792915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.841044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572f313-d243-4008-b83c-360396a5151b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:16.841650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572f313-d243-4008-b83c-360396a5151b service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.842508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572f313-d243-4008-b83c-360396a5151b service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.842750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572f313-d243-4008-b83c-360396a5151b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.844598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0572f313-d243-4008-b83c-360396a5151b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.853214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:16.871404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 695/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 24 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:16.878934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:16.886773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453474a-cbc1-4ae8-8355-6213fd4cd5b2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:16.938577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572f313-d243-4008-b83c-360396a5151b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:16.940151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572f313-d243-4008-b83c-360396a5151b service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:16.958932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 700/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:16.963689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:16.964473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:16.964702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:16.964973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:16.966620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:16.996691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:17.079061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:17.080500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144631ce-1165-4cca-bda8-d32493e78079 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:17.098941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 696/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:39:18.158692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389d70-7529-4eb0-834a-126c6e399c19 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.159156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389d70-7529-4eb0-834a-126c6e399c19 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.159330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf389d70-7529-4eb0-834a-126c6e399c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.225860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-bf389d70-7529-4eb0-834a-126c6e399c19 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:18.227315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bf389d70-7529-4eb0-834a-126c6e399c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.314749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:18.317901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 701/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:18.364871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.365336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.365520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.366912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 697/1398] 10.222.0.18 () {54 vars in 943 bytes} [Wed Aug 24 03:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:39:18.373156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786c56-e5d1-4dac-a41b-0872d13d0fd8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.373545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786c56-e5d1-4dac-a41b-0872d13d0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.373886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786c56-e5d1-4dac-a41b-0872d13d0fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.568643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-4d786c56-e5d1-4dac-a41b-0872d13d0fd8 None None] MFA Rules not processed for user `eced38ac42be41fa8aa9be12ca4ebde3`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:18.569766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4d786c56-e5d1-4dac-a41b-0872d13d0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.679928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 702/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Aug 24 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:18.695379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:18.697273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.836127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:18.838657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b69ac-beda-4fc3-b07b-362f607e9e52 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:18.943701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:18.944306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.944585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.944857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.946528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:19.030932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:19.032513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e03d3-1927-4156-8aea-d2e3d9538cfe service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:19.040486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 698/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:19.112584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:19.112916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:19.113194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:19.114592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 703/1401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:19.119954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf234-7e8d-4505-8d15-ed89f8ea0d0e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:19.120246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf234-7e8d-4505-8d15-ed89f8ea0d0e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:19.120531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cf234-7e8d-4505-8d15-ed89f8ea0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:19.157726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:19.186899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e14cf234-7e8d-4505-8d15-ed89f8ea0d0e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:19.188135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e14cf234-7e8d-4505-8d15-ed89f8ea0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:19.284209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 699/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:19.575672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:19.577272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:19.646714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:19.741150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c41db-9ea0-4d0e-9bc2-a65e28f74203 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:19.871439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:19.872151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:19.872496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:19.872862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:19.875225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:19.895487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:19.978936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:19.980930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceb5f5-bc7d-492d-95be-8ade159eca59 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:20.001807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 704/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:22.173319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:22.173860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:22.173978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:22.179226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 700/1404] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:22.181164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4ca4-a5a0-4a46-acac-2706e3ccef08 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:22.181613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4ca4-a5a0-4a46-acac-2706e3ccef08 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:22.181695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4ca4-a5a0-4a46-acac-2706e3ccef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:22.253614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5e2d4ca4-a5a0-4a46-acac-2706e3ccef08 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:22.254803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5e2d4ca4-a5a0-4a46-acac-2706e3ccef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:22.355050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:22.361450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 705/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:22.687170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:22.689164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:22.831638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:22.883349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38e1c-7d4f-478b-a902-9ea921d183b1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:23.041621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:23.042289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:23.042636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:23.042976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:23.044664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:23.154484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:23.156515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b645d-f417-41d5-a5a4-08208e6644ac service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:23.176268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 701/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:23.345344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:25.513548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:25.514124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:25.514124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:25.516162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 706/1407] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:25.521502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33caf-450d-4ec4-92af-6fa4135fc452 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:25.521994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33caf-450d-4ec4-92af-6fa4135fc452 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:25.522097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33caf-450d-4ec4-92af-6fa4135fc452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:25.597279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-68e33caf-450d-4ec4-92af-6fa4135fc452 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:25.598539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-68e33caf-450d-4ec4-92af-6fa4135fc452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:25.702511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 702/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:25.995923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:25.997459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:26.164199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581e4d9-4887-4035-8280-69690ca467a8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:26.238322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:26.290604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:26.291210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:26.291490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:26.291759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:26.293498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:26.396416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:26.398043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eda04-d6f1-414b-bc29-6d4be7fa84f0 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:26.422609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 707/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:35.699402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=79 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:36.420136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=64 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.145770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee424e0-82da-4597-8527-8231d83efc51 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.146344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee424e0-82da-4597-8527-8231d83efc51 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.146463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee424e0-82da-4597-8527-8231d83efc51 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.147803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 703/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 24 03:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:43.153158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026a1e-a991-4b45-91d3-b5cb33ceef07 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.153570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026a1e-a991-4b45-91d3-b5cb33ceef07 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.153707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b026a1e-a991-4b45-91d3-b5cb33ceef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.229783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1b026a1e-a991-4b45-91d3-b5cb33ceef07 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:43.231018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1b026a1e-a991-4b45-91d3-b5cb33ceef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:43.336894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 708/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:43.352160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8a5a-86bd-4a0b-8fdb-2b1c3bca890c None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.352445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8a5a-86bd-4a0b-8fdb-2b1c3bca890c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.352723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed8a5a-86bd-4a0b-8fdb-2b1c3bca890c None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.354102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 704/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 24 03:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:43.358674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e8bb-fe0a-480a-820d-6bd74dcfd775 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:43.359507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e8bb-fe0a-480a-820d-6bd74dcfd775 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:43.359720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e8bb-fe0a-480a-820d-6bd74dcfd775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:43.431495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:43.433976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f834e8bb-fe0a-480a-820d-6bd74dcfd775 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:43.435184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f834e8bb-fe0a-480a-820d-6bd74dcfd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:43.550614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 709/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 24 03:39:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:45.936741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:45.937300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:45.937300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:45.939457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:45.944731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602687-c53c-4b62-97ed-e2c1b87f81c9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:45.945184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602687-c53c-4b62-97ed-e2c1b87f81c9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:45.945283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602687-c53c-4b62-97ed-e2c1b87f81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:46.010956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d7602687-c53c-4b62-97ed-e2c1b87f81c9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:46.012150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d7602687-c53c-4b62-97ed-e2c1b87f81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:46.066131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:46.107895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:46.412946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:46.414693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:46.564968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb9e22-103c-4b9d-a18d-5b09c447a52d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:46.637042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:46.678141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:46.678750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:46.679032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:46.679372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:46.681722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:46.772768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:46.774410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267b3a0-bbe9-46b1-999a-560ee455f53e service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:46.793267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 706/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:47.690108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:47.690654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:47.690654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:47.692175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:47.697110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2b5-0603-45d4-a83f-56173739a676 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:47.697525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2b5-0603-45d4-a83f-56173739a676 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:47.697648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2b5-0603-45d4-a83f-56173739a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:47.772666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-40ffc2b5-0603-45d4-a83f-56173739a676 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:47.773923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-40ffc2b5-0603-45d4-a83f-56173739a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:47.801055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:47.869985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:48.021163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:48.022618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:48.166887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc3e4c-1345-47e4-8cd4-a9dcac027450 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:48.206367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:48.277872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:48.278437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:48.278718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:48.278992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:48.281271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:48.370331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:48.371917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaebaaa-5978-48ea-878a-c5809017c2c0 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:48.390555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 712/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:49.278621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:49.279134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:49.279242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:49.280606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:49.285724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7742-aaf6-4452-9198-0fb5658afb4b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:49.286217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7742-aaf6-4452-9198-0fb5658afb4b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:49.286315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7742-aaf6-4452-9198-0fb5658afb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:49.339718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:49.360958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0b8f7742-aaf6-4452-9198-0fb5658afb4b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:49.362197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0b8f7742-aaf6-4452-9198-0fb5658afb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:49.458470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:49.615321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:49.617276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:49.764023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727810ae-ef13-4738-927b-8da4f939f795 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:49.775969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:49.877129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:49.877728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:49.878072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:49.878345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:49.879971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:49.969969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:49.971842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf319c1-02e9-48fa-94c0-dffb5d536930 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:49.990381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 709/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:50.854564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:50.855111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:50.855111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:50.856524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:50.861393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff9b7-29f7-4970-94fe-27be66c6fd87 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:50.861785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff9b7-29f7-4970-94fe-27be66c6fd87 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:50.861965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ff9b7-29f7-4970-94fe-27be66c6fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:50.883133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:50.940303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7b0ff9b7-29f7-4970-94fe-27be66c6fd87 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:50.941608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7b0ff9b7-29f7-4970-94fe-27be66c6fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:51.037911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:51.187714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:51.189276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:51.298354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:51.334078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538d42b-90d6-4614-8083-6bcf4c98d4b1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:51.444548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:51.445149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:51.445430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:51.445706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:51.447353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:51.525799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:51.539128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:51.540732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b917528-537c-49c0-9990-7c62f3c80fa6 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:51.558710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 715/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:52.422764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:52.423315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:52.423315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:52.424662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:52.429523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b0ae-9b2e-4972-a7c6-1a72f72f1471 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:52.429965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b0ae-9b2e-4972-a7c6-1a72f72f1471 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:52.430104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b0ae-9b2e-4972-a7c6-1a72f72f1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:52.504874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d237b0ae-9b2e-4972-a7c6-1a72f72f1471 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:52.506098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d237b0ae-9b2e-4972-a7c6-1a72f72f1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:52.602524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:52.755276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:52.756812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:52.843710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.909586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d4299-3756-48c9-957e-cd75bcde5402 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:53.024140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:53.024745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:53.025025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:53.025300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:53.026928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:53.075517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:53.115842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:53.117546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5297-21a8-4584-9c75-c75ad504c709 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:53.135661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 712/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:54.063235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:54.063813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:54.063813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:54.065208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:54.070306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d4a-904f-444a-966d-e49196889c10 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:54.070758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d4a-904f-444a-966d-e49196889c10 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:54.070858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d4a-904f-444a-966d-e49196889c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:54.145565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bc671d4a-904f-444a-966d-e49196889c10 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:54.146817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc671d4a-904f-444a-966d-e49196889c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:54.241169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:54.392464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:54.394001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:54.450120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:54.551315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6498da-9118-4a80-a75a-5daeb1a68a96 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:54.664675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:54.665195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:54.665472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:54.665750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:54.667377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:54.674818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:54.762750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:54.764341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a492dd-4e94-493c-bd4d-480ead75b2ee service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:54.782009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 718/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:55.638381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:55.638939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:55.638939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:55.640359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:55.645406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab346-9046-4dd8-b9c8-9fd0413146c3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:55.645823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab346-9046-4dd8-b9c8-9fd0413146c3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:55.645964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaab346-9046-4dd8-b9c8-9fd0413146c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:55.720384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-dcaab346-9046-4dd8-b9c8-9fd0413146c3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:55.721840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-dcaab346-9046-4dd8-b9c8-9fd0413146c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:55.789771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:55.818785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:55.975884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:55.977337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:55.995211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:56.122200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3de5c7-f262-4dde-b31d-adad70fea809 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:56.208248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:56.243465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:56.243465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:56.243465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:56.243465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:56.243974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:56.335755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:56.337377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051848d-2017-4d92-b192-4b7fe7884821 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:56.355982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 715/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:57.222163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.222163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.222163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.222163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:57.226018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720d18-17ea-46ae-b580-c83b234eeb9e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.226421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720d18-17ea-46ae-b580-c83b234eeb9e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.226526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a720d18-17ea-46ae-b580-c83b234eeb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.304265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7a720d18-17ea-46ae-b580-c83b234eeb9e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:57.305476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a720d18-17ea-46ae-b580-c83b234eeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.347001 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.401261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:57.553692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:57.555213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.708625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4d7a-688d-495c-a44a-f0a10828f316 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:57.763521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.823955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:57.824471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.824748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.825018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.826682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.917104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:57.918746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740195-cde8-4435-9f42-32fc5bebdc6b service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:57.937109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 721/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:58.863976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:58.864560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:58.864560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:58.865920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:58.871363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c64e-0b3e-40d8-95ab-7705b0f57b36 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:58.871857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c64e-0b3e-40d8-95ab-7705b0f57b36 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:58.871970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c64e-0b3e-40d8-95ab-7705b0f57b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:58.952502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-22a5c64e-0b3e-40d8-95ab-7705b0f57b36 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:58.953622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-22a5c64e-0b3e-40d8-95ab-7705b0f57b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:58.955694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:59.051208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:59.204644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:59.206233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:59.356695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dfcd2-1ecc-4931-9140-fa89fc58ed7d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:59.383267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:59.470414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:59.470906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:59.471452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:59.471730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:59.473342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:59.563176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:59.564771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ac6b-fb0f-427a-bc7c-3fef02a6f73c service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:59.583462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 718/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:01.419730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098cf9-2895-4336-8b48-c40df705151d None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:01.420298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098cf9-2895-4336-8b48-c40df705151d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:01.420298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098cf9-2895-4336-8b48-c40df705151d None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:01.422163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:01.427616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5444e-4b02-4a61-ae4a-354b96e072ed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:01.428046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5444e-4b02-4a61-ae4a-354b96e072ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:01.428155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5444e-4b02-4a61-ae4a-354b96e072ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:01.468704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:01.493445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2dd5444e-4b02-4a61-ae4a-354b96e072ed None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:01.494686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2dd5444e-4b02-4a61-ae4a-354b96e072ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:01.591729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:01.879772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098cf9-2895-4336-8b48-c40df705151d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:01.881324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-72098cf9-2895-4336-8b48-c40df705151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:01.984726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098cf9-2895-4336-8b48-c40df705151d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:02.016914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:02.058452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:02.059053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:02.059335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:02.059607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:02.061214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:02.169750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:02.171184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4adb27-a731-49d2-a804-e168f6f1f572 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:02.190567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 724/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:04.255556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:04.256148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:04.256148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:04.257480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:04.262707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed70e-c78d-4927-901a-18601f254428 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:04.263129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed70e-c78d-4927-901a-18601f254428 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:04.263258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ed70e-c78d-4927-901a-18601f254428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:04.327754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9d5ed70e-c78d-4927-901a-18601f254428 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:04.329068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9d5ed70e-c78d-4927-901a-18601f254428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:04.341706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:04.427383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:04.713612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:04.715263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:04.817894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af671178-79c6-4128-b91f-5f53482b44e9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:04.830698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:04.892379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:04.893017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:04.893299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:04.893573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:04.895220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:05.003164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:05.004538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6870c-3bd2-4a6d-a449-45253480018d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:05.023322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 721/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:07.329398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.329990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.329990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.331368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:07.336660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10701-c569-40cc-8492-d78ebbd14f7b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.337107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10701-c569-40cc-8492-d78ebbd14f7b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.337245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e10701-c569-40cc-8492-d78ebbd14f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.386290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:07.404732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-67e10701-c569-40cc-8492-d78ebbd14f7b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:07.405965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-67e10701-c569-40cc-8492-d78ebbd14f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.502089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:07.785704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:07.787356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.890501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe7b7-eb76-4b98-b01a-d507d0ce5cc4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:07.931240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:07.968547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:07.969174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.969448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.969715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.971374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:08.080572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:08.081970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20095b67-e844-405c-8854-894ae3783edb service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:08.102106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 727/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:10.164634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:10.165167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:10.165167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:10.166605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:10.171815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d24c6-c1d8-4c4f-a336-c483d5967c2b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:10.172874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d24c6-c1d8-4c4f-a336-c483d5967c2b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:10.172981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d24c6-c1d8-4c4f-a336-c483d5967c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:10.237899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2f6d24c6-c1d8-4c4f-a336-c483d5967c2b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:10.239134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2f6d24c6-c1d8-4c4f-a336-c483d5967c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:10.259032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:10.334203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:10.619416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:10.620958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:10.725308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec97d97-a9fe-4783-9a1b-659e2ef33bb5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:10.745368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:10.799535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:10.800148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:10.800433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:10.800703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:10.802440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:10.911021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:10.912384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0324129-7a7f-4ab3-b345-1f34f4329f62 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:10.932332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 724/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:12.900789 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:12.901212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:12.901370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:12.902813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:12.908555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1af3b-e24f-44e6-9d9b-5177ef8118d8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:12.908971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1af3b-e24f-44e6-9d9b-5177ef8118d8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:12.909158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1af3b-e24f-44e6-9d9b-5177ef8118d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:12.974811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:12.980599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3fd1af3b-e24f-44e6-9d9b-5177ef8118d8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:12.980599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3fd1af3b-e24f-44e6-9d9b-5177ef8118d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.075235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:13.366981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:13.368572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.469960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcc959-c95c-46d9-acde-22ab37e4ac9b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:13.517352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:13.541848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:13.542477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.542754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.543025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.544620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.653155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:13.654658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24707-f0ac-4984-a243-4f313158f049 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:13.674758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 730/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:15.702722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:15.703152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:15.703272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:15.704621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:15.710087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e9a8-c671-406e-ab84-2ca53ed52564 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:15.710488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e9a8-c671-406e-ab84-2ca53ed52564 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:15.710634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e9a8-c671-406e-ab84-2ca53ed52564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:15.776399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-bd06e9a8-c671-406e-ab84-2ca53ed52564 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:15.777606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bd06e9a8-c671-406e-ab84-2ca53ed52564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:15.806246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:15.872532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:16.156774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:16.158429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:16.265637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d679bb-3ac5-45a1-a67a-7c7177cdacca None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:16.295650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:16.342395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:16.342995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:16.343288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:16.343554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:16.345242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:16.457000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:16.458423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73bb61-9e03-484a-a19b-60ad3648216d service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:16.476351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 727/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:18.515244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.515780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.515906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.517853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:18.523429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b54f6-82fd-4588-b5ed-a70196fb6576 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.523870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b54f6-82fd-4588-b5ed-a70196fb6576 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.523975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b54f6-82fd-4588-b5ed-a70196fb6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.593016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9e6b54f6-82fd-4588-b5ed-a70196fb6576 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:18.594266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9e6b54f6-82fd-4588-b5ed-a70196fb6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.602760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:18.692665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:18.975637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:18.977216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:19.082264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90fc6b-ef9a-4607-a5ee-b5ba01cb393a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:19.136586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:19.155504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:19.168482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:19.168482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:19.168482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:19.168482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:19.267349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:19.268832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021d55c-5f80-46f3-aec0-40c70e043b62 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:19.287349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 733/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:21.257982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:21.258494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:21.258600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:21.260003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:21.265570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406488f0-7200-4c6a-b97a-7df14ed0206a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:21.269684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406488f0-7200-4c6a-b97a-7df14ed0206a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:21.269684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406488f0-7200-4c6a-b97a-7df14ed0206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:21.333098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-406488f0-7200-4c6a-b97a-7df14ed0206a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:21.334260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-406488f0-7200-4c6a-b97a-7df14ed0206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:21.373551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:21.432027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:21.726817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:21.728390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:21.952179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc82bc-f116-4847-8824-ce662d70fd8a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:21.990161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:22.025565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:22.026263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:22.026558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:22.026829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:22.028433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:22.135152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:22.136594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc821f-5697-42d0-a13c-93866c7fd2b1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:22.155352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 730/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:24.186527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.187108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.187108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.189118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:24.194661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563953d1-2dff-471d-bb66-9be96a523368 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.195096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563953d1-2dff-471d-bb66-9be96a523368 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.195220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563953d1-2dff-471d-bb66-9be96a523368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.265017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-563953d1-2dff-471d-bb66-9be96a523368 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:24.266381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-563953d1-2dff-471d-bb66-9be96a523368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.284559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.361635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:24.649316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:24.650900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.758898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a927-f53d-4ac3-92c0-3ee52f045617 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:24.826025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.832639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:24.833241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.833519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.833794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.835434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.943863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:24.945252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f5e90-5dd3-4087-afd7-fa077c209806 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:24.963232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 736/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:26.921554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.922169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.922169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.924019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:26.931470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e5b-4b78-4d9e-80ce-a0aaafc87270 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.932088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e5b-4b78-4d9e-80ce-a0aaafc87270 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.932088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3e5b-4b78-4d9e-80ce-a0aaafc87270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.998455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-953d3e5b-4b78-4d9e-80ce-a0aaafc87270 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:26.999583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-953d3e5b-4b78-4d9e-80ce-a0aaafc87270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.047162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.098939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:27.391968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:27.393512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.497107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a2f5-1054-4fba-8d33-e3e1d7ef8588 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:27.544363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.570612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:27.571213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:27.571497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:27.571767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:27.573419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.681501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:27.682975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b159e0-5e03-4e92-b140-dbec26590ab1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:27.701310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 733/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:37.096885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=22 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:37.699018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=66 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.254303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd369eb-7f56-43f5-a220-4b7955ede098 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.254872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd369eb-7f56-43f5-a220-4b7955ede098 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.254872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd369eb-7f56-43f5-a220-4b7955ede098 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.256200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 738/1471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:48.261491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be320-cd75-45f2-9b82-75d22e7a52d9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.261927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be320-cd75-45f2-9b82-75d22e7a52d9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.262053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be320-cd75-45f2-9b82-75d22e7a52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.325678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-270be320-cd75-45f2-9b82-75d22e7a52d9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:48.326888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-270be320-cd75-45f2-9b82-75d22e7a52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.421497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 734/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:48.717716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.718054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.718338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.719670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 739/1473] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 24 03:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:48.725489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6efb8-4b2c-4967-a1d7-19a30bb6c482 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.725800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6efb8-4b2c-4967-a1d7-19a30bb6c482 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.726115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6efb8-4b2c-4967-a1d7-19a30bb6c482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.801304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d5a6efb8-4b2c-4967-a1d7-19a30bb6c482 None None] MFA Rules not processed for user `f7039ec3afcd41b7b006d1179e19cbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:48.802465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d5a6efb8-4b2c-4967-a1d7-19a30bb6c482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.823014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.878379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 735/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 24 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:48.885986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:48.887556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.991033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fb32-6c61-4b47-9ed3-22a930ed35c6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:49.063902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:49.064420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.064702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.065520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.067164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.120258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:49.175286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:49.176719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ddf85-e394-4080-a685-250a840eb317 service glance] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:49.195544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 740/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:51.266271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.266709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.266824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.268205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 736/1476] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:51.273620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf7a-ae6c-4773-9b9a-35cb81257f95 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.274083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf7a-ae6c-4773-9b9a-35cb81257f95 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.274200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03cf7a-ae6c-4773-9b9a-35cb81257f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.339012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0f03cf7a-ae6c-4773-9b9a-35cb81257f95 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:51.340243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0f03cf7a-ae6c-4773-9b9a-35cb81257f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.435712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 741/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:51.713973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:51.715507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.838709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a9ef-4520-4ed9-87ff-9888191c53c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:51.888235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.937516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:51.938149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.938431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.938703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.939343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:51.941102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:51.941102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:40:51.941102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:40:51.942290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8da49b-70b9-47c9-9753-28f3caf9d0b5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:51.964627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 737/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 24 03:40:51 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:40:53.914208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:53.914780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:53.914780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:53.916134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 742/1479] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:53.921551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b64c-b165-4a2a-9d6f-130ad1d3a432 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:53.922031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b64c-b165-4a2a-9d6f-130ad1d3a432 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:53.922149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b64c-b165-4a2a-9d6f-130ad1d3a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:53.988649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9795b64c-b165-4a2a-9d6f-130ad1d3a432 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:53.989850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9795b64c-b165-4a2a-9d6f-130ad1d3a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:54.084313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 738/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:54.375991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:54.377587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:54.387541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:54.524772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b8f1f-e33f-4e81-8ec2-ed3ea542617b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:54.605944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:54.640057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:54.640587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:54.640894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:54.641168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:54.642830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:54.732168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:54.733894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46146bb7-f04b-445d-ab49-039945ba3a3c service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:54.751526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 743/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:56.841109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.841692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.841692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.843071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 739/1482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:56.849243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f06d3-6a78-45c6-a105-51dbe6d81c27 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:56.849686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f06d3-6a78-45c6-a105-51dbe6d81c27 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:56.849797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f06d3-6a78-45c6-a105-51dbe6d81c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:56.918086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-718f06d3-6a78-45c6-a105-51dbe6d81c27 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:56.919311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-718f06d3-6a78-45c6-a105-51dbe6d81c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:56.965534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:57.015465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 744/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:57.299502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:57.301655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:57.326428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:57.404819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a09b8f-b64e-41d5-a5e1-f1e6e59d9ee3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:57.478850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:57.479457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:57.479736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:57.480004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:57.481614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:57.555870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:57.589859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:57.591332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c933e1-ef3e-4856-9150-9545d0b5ccc7 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:57.610448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 740/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:59.570708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:59.571250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:59.571250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:59.572583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 745/1485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:59.578049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c2d0-3aec-4163-91dc-63f7e31f28c4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:59.578484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c2d0-3aec-4163-91dc-63f7e31f28c4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:59.578631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1c2d0-3aec-4163-91dc-63f7e31f28c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:59.645675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-52e1c2d0-3aec-4163-91dc-63f7e31f28c4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:59.646919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-52e1c2d0-3aec-4163-91dc-63f7e31f28c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:59.744325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 741/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:00.035972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:00.037556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:00.141149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4936cae-8ae3-4872-ad01-b2634deca4a5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:00.214116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:00.215929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:00.216520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:00.216793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:00.217062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:00.218728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:00.326231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:00.327615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc2eb-5109-42a6-9043-7d3471529a58 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:00.346047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 746/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:02.409375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:02.409962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:02.409962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:02.411334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 742/1488] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:02.416697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24f60-9572-44ed-8267-8bf804b1e6ec None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:02.417109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24f60-9572-44ed-8267-8bf804b1e6ec None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:02.417250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c24f60-9572-44ed-8267-8bf804b1e6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:02.482237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-80c24f60-9572-44ed-8267-8bf804b1e6ec None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:02.483446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-80c24f60-9572-44ed-8267-8bf804b1e6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:02.536243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:02.581198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 747/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:02.876961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:02.879165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:02.915142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:02.982628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71345fb-4c16-4bd9-bd5a-67efa2071ccb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:03.071014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:03.071616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:03.071943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:03.072216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:03.073824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:03.153267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:03.181281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:03.182739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233ce86-eafa-4956-adc4-6cdd6f97af32 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:03.202051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 743/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:05.637922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:05.642208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:05.642208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:05.642208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 748/1491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 24 03:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:05.645319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e5f7-f9bd-4721-b4cb-18f58e11c286 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:05.645715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e5f7-f9bd-4721-b4cb-18f58e11c286 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:05.645947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e5f7-f9bd-4721-b4cb-18f58e11c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:05.785147 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6e75e5f7-f9bd-4721-b4cb-18f58e11c286 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:05.785147 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6e75e5f7-f9bd-4721-b4cb-18f58e11c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:05.834087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 744/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 24 03:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:06.124176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:06.125733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:06.227905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc656a-b50d-4f37-b5ac-0f82b030f660 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:06.300708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:06.301304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:06.301579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:06.301846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:06.303468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:06.313342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:06.412762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:06.414149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeed4ea-1d93-48c9-ad42-1512927c651f service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:06.431712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 749/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:15.832250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=82 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:16.429447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=50 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:35.361166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.361811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.361811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.437239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:35.438472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.535675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 745/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:35.544346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.544845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.544954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.620147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:35.621356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.718485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 750/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:35.723261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:35.724465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:35.736547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b542-a42f-4673-bdcf-9c1ede74d0ac None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:35.797707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:35.831153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:35.831754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.832035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.832310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.832946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:42:35.833250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:35.834301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:35.834301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:42:35.834301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:42:35.835190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:35.846707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 746/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:42:35.855377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:35.865315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0b4a1-2088-4ab7-909c-befbef1417e0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:35.926033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:35.958580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:35.959170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:35.959445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:35.959710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:35.960331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:35.962640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:35.962640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:42:35.962640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:42:35.964191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.083043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 751/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:42:35 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:36.087169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.088726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:36.122433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c8664-97ef-40a1-8dfa-ac16384d5028 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.245578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.246123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.246399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.246673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.247313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.248311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:36.248311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:42:36.248311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:42:36.249516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.351063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 747/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:42:36 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:42:36.359111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.360620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:36.426084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff8cd-9138-4f41-bfd8-c671931be0c5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.522833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:36.533495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:42:36.545264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:42:36.546325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.549150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 752/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:36.553242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.554868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:36.567510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d853f-82f9-47cb-8e48-27b02761f447 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.593923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:36.666768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.667372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.667648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.667917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.668553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.669576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:36.669576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:42:36.669576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:42:36.670484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7d7a1-5b59-4306-8743-90206722f62d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.683055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 748/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:36.687789 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:36.689329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:36.722733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bcc6f-336b-46a0-bce5-823274f55ea8 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:36.816022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:36.816605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.816884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.817155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] PATH_INFO: `/v3/projects/4f39114d7ea94814b4cf994b396010bd/users/76672f26d2934b4d90a938f988640e45/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:36.839866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f39114d7ea94814b4cf994b396010bd, user_id=76672f26d2934b4d90a938f988640e45, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:36.840923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:36.840923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:42:36.840923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:42:36.842894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668d824-049a-4134-b603-d5e5e772e5d6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:36.934298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 753/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:42:36 2022] PUT /identity/v3/projects/4f39114d7ea94814b4cf994b396010bd/users/76672f26d2934b4d90a938f988640e45/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:36.947045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60024-5c46-4d90-aecf-589ce6d230c0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:36.947942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60024-5c46-4d90-aecf-589ce6d230c0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:36.947942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60024-5c46-4d90-aecf-589ce6d230c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.004571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a4b60024-5c46-4d90-aecf-589ce6d230c0 None None] MFA Rules not processed for user `76672f26d2934b4d90a938f988640e45`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:37.005785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a4b60024-5c46-4d90-aecf-589ce6d230c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.082672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 749/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:42:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:37.095609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.095908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.096185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.097525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 754/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 24 03:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:37.102237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbde924-3e1a-44a4-993d-176bffdf2e3f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.102521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbde924-3e1a-44a4-993d-176bffdf2e3f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.102792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbde924-3e1a-44a4-993d-176bffdf2e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.134203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.254863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bfbde924-3e1a-44a4-993d-176bffdf2e3f None None] MFA Rules not processed for user `634e36d89a344c1a87946891dbdbbfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:37.256101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bfbde924-3e1a-44a4-993d-176bffdf2e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.332022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 750/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 24 03:42:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:37.340128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:37.342144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.391962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.444903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2adea-f690-45a5-8fac-8dff50c9c317 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:37.517748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:37.518379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.518658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.518932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.520531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.643984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:37.645434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:37.648982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:37.663885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 755/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:37.711879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cfcf-e3b6-4d7e-88f1-dc897ba6d00b None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.712522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cfcf-e3b6-4d7e-88f1-dc897ba6d00b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.712522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cfcf-e3b6-4d7e-88f1-dc897ba6d00b None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.713676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 751/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Aug 24 03:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:37.718153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:37.719368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:37.818070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b86ce-4d15-4f17-9a84-c69bec250cb8 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:37.917238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:37.917785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:37.918107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:37.918380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] PATH_INFO: `/v3/users/76672f26d2934b4d90a938f988640e45` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:37.930850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76672f26d2934b4d90a938f988640e45)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:37.931925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:37.931925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:42:37.931925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:42:37.933159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:37.943097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.234979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76672f26d2934b4d90a938f988640e45'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:38.235342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76672f26d2934b4d90a938f988640e45'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:38.249398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76672f26d2934b4d90a938f988640e45'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:38.249974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76672f26d2934b4d90a938f988640e45'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:38.272549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76672f26d2934b4d90a938f988640e45'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:38.378705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 756/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:42:37 2022] DELETE /identity/v3/users/76672f26d2934b4d90a938f988640e45 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:38.383194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.383513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.383889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.442058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:38.443282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.518622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.531294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 752/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:38.541141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:38.542397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.644837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9905553-cce3-41f9-b956-6e7958e4d44b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:38.699542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:38.719633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:38.720764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:38.720764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:38.720764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:38.722408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:38.833767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:38.835159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ea09-9acb-41cb-bfcd-dc292a7fee6d service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:38.853777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 757/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:39.347819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:39.349054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:39.360725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d459f8-502b-4de2-b7a0-ffd367b97615 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:39.458738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:39.459412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:39.465136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:39.465136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] PATH_INFO: `/v3/projects/4f39114d7ea94814b4cf994b396010bd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:39.470701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f39114d7ea94814b4cf994b396010bd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:39.471726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:39.471726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:42:39.471726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:42:39.473099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:39.618985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f39114d7ea94814b4cf994b396010bd', 'request_id': 'req-1761748b-505f-4089-beb1-ec08c1322abf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:39.625564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f39114d7ea94814b4cf994b396010bd', 'request_id': 'req-1761748b-505f-4089-beb1-ec08c1322abf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:39.639375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f39114d7ea94814b4cf994b396010bd', 'request_id': 'req-1761748b-505f-4089-beb1-ec08c1322abf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:39.763840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] The token cache is being invalidate because project 4f39114d7ea94814b4cf994b396010bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:42:39.764153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:39.764656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1761748b-505f-4089-beb1-ec08c1322abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:42:39.766084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 753/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:42:39 2022] DELETE /identity/v3/projects/4f39114d7ea94814b4cf994b396010bd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:42:48.851570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=62 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:49.761060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:16.574632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.575359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.575359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:16.576625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:16.581387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f4bf-60ac-4dca-a05c-3975a6fbf11a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:16.581843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f4bf-60ac-4dca-a05c-3975a6fbf11a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:16.581992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f4bf-60ac-4dca-a05c-3975a6fbf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:16.663690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8916f4bf-60ac-4dca-a05c-3975a6fbf11a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:16.664888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8916f4bf-60ac-4dca-a05c-3975a6fbf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:16.769818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:16.929101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:16.931392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.051535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7569e-cf92-4d4e-a1fe-014b4715df8a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:17.057064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:17.057661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.057970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.058239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.066768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:17.068360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849d5b-f413-4c2a-877b-78eb137e9cc6 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:17.078172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 759/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:17.935753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a004-9acb-4492-8237-6c5554a02f99 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.936360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a004-9acb-4492-8237-6c5554a02f99 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.936360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876a004-9acb-4492-8237-6c5554a02f99 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.937717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:17.942661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385db84-6460-4eee-a054-f0d0c30ca0d3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:17.943064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385db84-6460-4eee-a054-f0d0c30ca0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:17.943222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385db84-6460-4eee-a054-f0d0c30ca0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:17.962264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9385db84-6460-4eee-a054-f0d0c30ca0d3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:17.963396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9385db84-6460-4eee-a054-f0d0c30ca0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:17.971771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:18.126587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a004-9acb-4492-8237-6c5554a02f99 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:18.141866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876a004-9acb-4492-8237-6c5554a02f99 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:18.147405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:18.148005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.148308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.148583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.157602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:18.159313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986299a-6b17-4dd9-8731-bd09018e36dd service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:18.169822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 756/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:18.191491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f879-c346-4d6f-b314-41df100b9a5f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.191781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f879-c346-4d6f-b314-41df100b9a5f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.192058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98f879-c346-4d6f-b314-41df100b9a5f None None] PATH_INFO: `/v3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.193340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 761/1517] 10.222.0.86 () {54 vars in 925 bytes} [Wed Aug 24 03:44:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:44:18.200061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811724-efd6-4ab2-8a5c-9c1e6b5743f9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:18.200351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811724-efd6-4ab2-8a5c-9c1e6b5743f9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:18.200630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811724-efd6-4ab2-8a5c-9c1e6b5743f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:18.266787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d4811724-efd6-4ab2-8a5c-9c1e6b5743f9 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:18.267936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d4811724-efd6-4ab2-8a5c-9c1e6b5743f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:18.285912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:18.343460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 757/1518] 10.222.0.86 () {58 vars in 1015 bytes} [Wed Aug 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:27.848875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62559-345c-47fe-bfc4-8795cc7d43a7 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:27.849389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62559-345c-47fe-bfc4-8795cc7d43a7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:27.849485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62559-345c-47fe-bfc4-8795cc7d43a7 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:27.850924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 762/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 24 03:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:27.855719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575549-b21d-428a-b487-26b0b019018c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:27.856129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575549-b21d-428a-b487-26b0b019018c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:27.856279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48575549-b21d-428a-b487-26b0b019018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:27.877062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-48575549-b21d-428a-b487-26b0b019018c None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:27.878344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-48575549-b21d-428a-b487-26b0b019018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:27.886942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 758/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 24 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:27.894584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d62559-345c-47fe-bfc4-8795cc7d43a7 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:27.909063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d62559-345c-47fe-bfc4-8795cc7d43a7 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:27.914023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:27.914602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:27.914882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:27.915156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:27.924122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:27.925684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c3ef5-df6e-483e-99b5-d32b053c9822 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:27.935247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 763/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:29.406328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd39f-bbc2-4571-a996-12a4327bc416 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.406773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd39f-bbc2-4571-a996-12a4327bc416 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.406893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bd39f-bbc2-4571-a996-12a4327bc416 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.408251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:29.412966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c657-6467-4de5-8259-db5658162761 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.413391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c657-6467-4de5-8259-db5658162761 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.413538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65c657-6467-4de5-8259-db5658162761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.433299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7e65c657-6467-4de5-8259-db5658162761 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:29.434535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7e65c657-6467-4de5-8259-db5658162761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:29.442458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:29.599018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd39f-bbc2-4571-a996-12a4327bc416 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:29.614823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bd39f-bbc2-4571-a996-12a4327bc416 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:29.619637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:29.620226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:29.620538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:29.620797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:29.628835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:29.630429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f556023-9aa4-4b8e-9c42-0ea4be1aba0c service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:29.640182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 760/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:30.473719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf212d-b343-46f9-a21c-47623b946491 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.474332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf212d-b343-46f9-a21c-47623b946491 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.474448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf212d-b343-46f9-a21c-47623b946491 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.475871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:30.480889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0a29-a6d6-4178-b0f1-a124cae2e948 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.481310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0a29-a6d6-4178-b0f1-a124cae2e948 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.481502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0a29-a6d6-4178-b0f1-a124cae2e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.502160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b94c0a29-a6d6-4178-b0f1-a124cae2e948 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:30.503653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b94c0a29-a6d6-4178-b0f1-a124cae2e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:30.511549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:44:30.666652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf212d-b343-46f9-a21c-47623b946491 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:30.681669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf212d-b343-46f9-a21c-47623b946491 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:30.687265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:30.687858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:30.688142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:30.688423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:30.696889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:30.698515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f44d1d-0369-4568-bef8-4db172d535d8 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:30.707969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 766/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:34.899543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:34.900143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:34.900143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:34.901442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:34.906727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a438e6-74c1-47b4-9d95-18a11ad57d43 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:34.907180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a438e6-74c1-47b4-9d95-18a11ad57d43 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:34.907288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a438e6-74c1-47b4-9d95-18a11ad57d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:34.926780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-67a438e6-74c1-47b4-9d95-18a11ad57d43 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:34.927976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-67a438e6-74c1-47b4-9d95-18a11ad57d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:34.935806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:35.224335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:35.226128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:35.302986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13836af2-8a7a-4537-a844-c620dc074432 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:35.306598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:35.307188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:35.307467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:35.307738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:35.317500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:35.318958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e5b0c-624b-459f-88ee-d898b84c7443 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:35.328696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 763/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:37.218686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134b0e-9b18-4ed9-b790-ee9b3e118fb9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.219270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134b0e-9b18-4ed9-b790-ee9b3e118fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.219270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f134b0e-9b18-4ed9-b790-ee9b3e118fb9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.220580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:37.225901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad9b4-bd6a-4f60-967d-07f6e4537598 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.238011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad9b4-bd6a-4f60-967d-07f6e4537598 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.238011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad9b4-bd6a-4f60-967d-07f6e4537598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.246299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-609ad9b4-bd6a-4f60-967d-07f6e4537598 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:37.247481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-609ad9b4-bd6a-4f60-967d-07f6e4537598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:37.255946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:37.540716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134b0e-9b18-4ed9-b790-ee9b3e118fb9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:37.552285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f134b0e-9b18-4ed9-b790-ee9b3e118fb9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:37.555833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:37.556421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:37.556702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:37.556976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:37.565874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:37.567329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e50c4a-c389-4bb8-98b4-5e6ea2b7a911 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:37.576719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 769/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:40.915154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:40.915726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:40.915726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:40.917045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:40.923266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc5ce-9a80-4ba4-8b77-8fef263a690b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:40.923708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc5ce-9a80-4ba4-8b77-8fef263a690b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:40.923824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc5ce-9a80-4ba4-8b77-8fef263a690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:40.935941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=81 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:40.956557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8e7dc5ce-9a80-4ba4-8b77-8fef263a690b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:40.956557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8e7dc5ce-9a80-4ba4-8b77-8fef263a690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:40.956557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:41.511253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:41.512956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:41.589035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:41.602507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8991a8c-459d-4600-b4a8-16f172ece8ed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:41.606849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:41.606849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:41.607084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:41.607217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:41.617867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:41.619337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbacd85-5bad-4738-9a9d-470d71932dbe service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:41.629796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 766/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:43.566441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:43.566970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:43.567084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:43.568368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:44:43.573633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414406c-c660-41f9-939d-ea8cd3318452 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:43.574098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414406c-c660-41f9-939d-ea8cd3318452 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:43.574215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414406c-c660-41f9-939d-ea8cd3318452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:43.593749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4414406c-c660-41f9-939d-ea8cd3318452 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:44:43.594976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4414406c-c660-41f9-939d-ea8cd3318452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:43.603564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:44:44.160479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:44.162223 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:44.175843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb01359-d54e-4cee-86a9-987a8b15c106 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:44.179383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:44.179966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:44.180244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:44.180517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:44.189455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:44.190925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd06d5-fe48-4fa8-a4a1-aa47fa6d57bf service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:44.200274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 772/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:53.588529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=11 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:54.196122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=8 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:22.263073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.264799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.264799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.288844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.294556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.304959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 768/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:22.313753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd248-1111-41b5-9875-203b37f408cb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.314374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd248-1111-41b5-9875-203b37f408cb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.314374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdd248-1111-41b5-9875-203b37f408cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.345432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-48cdd248-1111-41b5-9875-203b37f408cb None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.346714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-48cdd248-1111-41b5-9875-203b37f408cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.359692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 773/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:22.364718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.380435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f5777-1d80-41d8-83ea-9f39c0aa6163 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.388568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.389606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.390142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.390660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.391532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:22.392143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:22.393983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:22.401966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e628bc-fd55-4e49-9075-a3b87c216489 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.401966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e628bc-fd55-4e49-9075-a3b87c216489 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.401966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e628bc-fd55-4e49-9075-a3b87c216489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.417118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 769/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:22.425109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.440733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d8e628bc-fd55-4e49-9075-a3b87c216489 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.440952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9266ef-e75b-4bd1-bc13-6fca7f3a06b4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.442061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d8e628bc-fd55-4e49-9075-a3b87c216489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.448819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.449700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.450243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.450854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.451832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:22.453161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:22.453161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:46:22.453161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:46:22.454945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:22.457613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 774/1543] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 03:46:22.467792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab46d-0067-495b-864f-51d683efe332 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.468100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab46d-0067-495b-864f-51d683efe332 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.468346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab46d-0067-495b-864f-51d683efe332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.507777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-660ab46d-0067-495b-864f-51d683efe332 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.509086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-660ab46d-0067-495b-864f-51d683efe332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.527536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 775/1544] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:22.530947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab46d-0067-495b-864f-51d683efe332 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.543487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab46d-0067-495b-864f-51d683efe332 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.549964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.550637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.550919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.551188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.552021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:22.552359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:22.553414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:22.553414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:46:22.553414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:46:22.554433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:22.574770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 776/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:46:22.584222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.598214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 770/1546] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:46:22.600060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb2e7-b9be-417c-8fde-81eb44bd0307 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.603333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.704559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70283-646c-489a-b54c-8cd7e3bad357 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.710169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.710169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.710169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.710583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.711026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:22.713134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a4fd9-ac8f-4060-92ae-044d4eb24f18 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:22.720903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.722141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.722657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.723183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.724149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:22.726907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc834a-494a-425e-9c5b-604993be4f16 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:22.823886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 777/1547] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:22.825238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.825534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.825811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.848035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 771/1548] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:46:22.854704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.855005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.855290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.876161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.877387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.902313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:22.903580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:22.980606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 778/1549] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:22.981463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:22.992603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197b6d-38ef-4cf7-b6ee-75c2de31a194 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:22.997586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:22.998240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:22.998512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:22.998780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:22.999440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.000467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:23.000467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:46:23.000467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:46:23.001657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac8b4-b4b8-4386-ba99-5fdb672df849 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.009235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 772/1550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.009235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.019315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c169a9-c0c0-4064-8b03-74c560639104 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.024445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.025052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.025333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.025613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.026340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.028035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e6eb5-5b76-4dcf-8487-1263c2530f06 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.039058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 773/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:23.041556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bf84-5e09-4711-a67a-d629a98aaab0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.041699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bf84-5e09-4711-a67a-d629a98aaab0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.042223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344bf84-5e09-4711-a67a-d629a98aaab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.064327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2344bf84-5e09-4711-a67a-d629a98aaab0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.065531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2344bf84-5e09-4711-a67a-d629a98aaab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.079944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 774/1552] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.079944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b8f-dedb-4a60-a329-7c997c910924 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.079944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b8f-dedb-4a60-a329-7c997c910924 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.079944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b8f-dedb-4a60-a329-7c997c910924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.094676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6ace3b8f-dedb-4a60-a329-7c997c910924 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.095857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6ace3b8f-dedb-4a60-a329-7c997c910924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.104501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 775/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.108679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 779/1554] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:22 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:23.108806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657209-26ae-4003-8493-88a7f779934b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.108806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657209-26ae-4003-8493-88a7f779934b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.108806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657209-26ae-4003-8493-88a7f779934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.109087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796c06-0b65-4c02-9791-2288cc986114 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.109087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796c06-0b65-4c02-9791-2288cc986114 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.109087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796c06-0b65-4c02-9791-2288cc986114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.131928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6c796c06-0b65-4c02-9791-2288cc986114 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.132144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bc657209-26ae-4003-8493-88a7f779934b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.133120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6c796c06-0b65-4c02-9791-2288cc986114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.133236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc657209-26ae-4003-8493-88a7f779934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.140954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 780/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.141087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 776/1556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.142220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.142506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.142792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.147362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbba2-d3cc-4a5e-b1a1-7bab2604fb20 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.147906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbba2-d3cc-4a5e-b1a1-7bab2604fb20 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.148163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbba2-d3cc-4a5e-b1a1-7bab2604fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.162677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.163880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.168776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-eb1bbba2-d3cc-4a5e-b1a1-7bab2604fb20 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.169928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-eb1bbba2-d3cc-4a5e-b1a1-7bab2604fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.175455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 777/1557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.175455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.177304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:23.180183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 781/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.181301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.181587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.181858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.183024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f315c49-677c-412f-bcef-85b072e68da4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.189402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.190023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.190310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.190586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.191230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.192847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc11a2-885f-4a96-82ed-cfae3fd9fb7c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.201349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.202561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.206466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 778/1559] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:23.206466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.206466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.206466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.214965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 782/1560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.215137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.225559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41fd94-2275-4d80-9ac8-ce4dc38f6886 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.227420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.230489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.230724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.231321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.231607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.231878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.232524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.234199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3f292-1c4e-4072-96a9-e48cc3a41ec8 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.237035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 779/1561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.237700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.244576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 783/1562] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:23.245919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7687c-cb21-4aab-a1ff-aa59687cf154 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.246239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7687c-cb21-4aab-a1ff-aa59687cf154 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.246520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7687c-cb21-4aab-a1ff-aa59687cf154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.247621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b3d5c-4f85-41a1-8a52-f5aca7de7182 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.252157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.252751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.253072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.253370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.254120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.254458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.255452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:23.256061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.265823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0fa7687c-cb21-4aab-a1ff-aa59687cf154 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.267062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0fa7687c-cb21-4aab-a1ff-aa59687cf154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.267947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 780/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.268795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.276056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 784/1564] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.277355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.277654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.277929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.280018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfbe3-6a63-4d2f-bef2-7394b1463172 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.284577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.285611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.285611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.285816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.286409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.287259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.288831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.298454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.299726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.301023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 781/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.301906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.308801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 785/1566] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.314297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.315051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e64e-77a1-4089-93a3-2abddf725b7d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.319177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f8a7-bbe2-4eb1-b9f4-7a2f9f8a9b83 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.321118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.321895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.322386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.322737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] PATH_INFO: `/v3/projects/17808c40ec1c41e5b0f5d8271826f7e9/users/8947c9cf75d642c88f1dc2f4382025bb/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.323893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.324484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.324759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.325030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.325714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.326095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.327698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.338998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17808c40ec1c41e5b0f5d8271826f7e9, user_id=8947c9cf75d642c88f1dc2f4382025bb, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.339963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:23.339963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:46:23.339963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:46:23.340247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 786/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.340992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.341885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.357129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ce531-b8f7-4522-bc17-7d42e86388fe admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.361743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.362436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.362722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.363021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.363654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.363956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.365947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.377876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 787/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.378687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.388459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6ddc9-524f-49c1-ac82-fadd5b72c202 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.393188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.393763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.394097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.394404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.395031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.397158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.406970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 788/1569] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:23.407860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.418372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28421f14-2fc9-4cec-b44a-0c25e7ca81fe admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.419797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 782/1570] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:23 2022] PUT /identity/v3/projects/17808c40ec1c41e5b0f5d8271826f7e9/users/8947c9cf75d642c88f1dc2f4382025bb/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:23.420488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.478620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.479224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.479503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.479774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.480395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.482281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d2bf-a6da-43eb-97ea-f1b26c871d5f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.482392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.486976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.487574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.487855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.488129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.488769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.489071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.490981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.502305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 783/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.503087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.512565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8bfb1-41de-4db6-b22e-5ebcdae6436a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.517156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.517720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.518031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.518328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.518920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.520812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.561322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 789/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:23.561322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.625948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222465d6-d555-49ef-9369-ba23455ecd09 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.630650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.631245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.631522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.631791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.632458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:23.632746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.634376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.645834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 790/1573] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:23.647198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.657299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 784/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:23.659885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cca37a-7a0a-4cce-bb4d-3e7c5e544360 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.660024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.693549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:23.722997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.723602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.723883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.724201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.725437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.727376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.734431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9d8a-2906-4f96-bccd-b0a51c3880fc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.739185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.739806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.740099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.740632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.741258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.743366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698f1d8-6c4d-426e-99ba-326e31b36051 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.755052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:23.848295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 791/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:23.850033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.891441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 785/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:23.891441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.891441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.891441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.902905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:23.904327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:23.914122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb0909-f3e2-47de-9a2d-272c9289c627 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.968799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 786/1577] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:23.968799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:23.974430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.975213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.975595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.975833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae08e-7e15-46fa-950b-c8f560c38037 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:23.975936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] PATH_INFO: `/v3/projects/0ebb2fce94ed44dbb9c625d48e6b781c/users/14e8865cb1b84e4b89978ba735ec2037/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.981339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:23.981960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:23.982246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:23.982522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:23.983152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.985500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:23.991371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebb2fce94ed44dbb9c625d48e6b781c, user_id=14e8865cb1b84e4b89978ba735ec2037, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:23.994158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.074514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 792/1578] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:23 2022] PUT /identity/v3/projects/0ebb2fce94ed44dbb9c625d48e6b781c/users/14e8865cb1b84e4b89978ba735ec2037/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:24.075305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.106951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 787/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:23 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.106951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.128890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:24.143382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae827d5-8218-4c04-897d-670c9f2856cf admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.167215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cdeac-154f-4afe-92c8-b1127e168cf9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.172371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.172971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.173249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.173521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.174173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.176207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.200821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.201432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.201712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.202015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.202637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.204562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.270992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 788/1580] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.272406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.304751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 793/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.305896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.315727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285978ee-ef30-49dc-a924-7864e595c3aa admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.331906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:24.337748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e081e5-ff12-401b-aa60-f9d9cea0db53 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.342660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.343352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.343636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.343902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.344518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.346463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.373771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.374422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.374701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.374973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.375638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.377580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.435217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 789/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.436133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.446408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6b664-e3bf-4da0-a525-876892953d73 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.450990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.451559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.451843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.452122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.452724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.454679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.463864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 794/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 305 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.466466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.518572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f03ed2-2323-488e-b998-fd56653c73da admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.522268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.522863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.523140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.523408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.532168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.533632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaf09b-ff4a-47e3-85b5-4c63f8e3c466 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.542893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 795/1584] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:24.544045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.544326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.544647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.563598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:24.565664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:24.573983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 790/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.577765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 796/1586] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:24.577906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.578146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.586251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99a2f-44c3-4799-9641-5178cec78c0b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.587775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99743a6c-05e7-4666-93ab-7e290e734e74 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.592050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.592288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.592852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.592970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.593133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.593240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.593431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.593536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.594083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.594217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.596004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.596259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.606763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:24.698948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 797/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.699870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.700783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 791/1588] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:24 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:24.702354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.713349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf242c-2cf9-4fd5-ba7f-69dc7c86f47a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.713677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35b76-8d9f-4fe8-a2cd-478c098befc1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.718164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.718670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.718862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.719082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.719275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.719388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.719629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.719829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.719944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.720475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.721518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.722129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.733143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 792/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.733322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 798/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.736458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.736576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.745471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a8856-f139-498b-b901-def54c404087 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.746400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a479d-d364-4d2b-9df8-a2c88b453bd3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.750201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.750814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.750927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.751080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.751357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.751503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.751782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.751990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.752102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.752673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.753599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.754308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.763583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 793/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.764291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 799/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.764509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.767742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.776122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2dec-475c-4048-acfe-38c0717ce8da admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.777728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95097c-3ada-41c9-b1dd-539ea952f413 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.779741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.780326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.780603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.780874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.782522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.783111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.783388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.783664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.784350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.785944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.791067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.792517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.800768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 800/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.802074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.802875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 794/1594] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:24.803694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.813243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968171d6-fe3c-4d90-af0f-14b437b0166c service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.814521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27038-ad0e-4faa-b7d0-6e9a8401f9a2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.818092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.818686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.818963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.819235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.819470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.819870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.820154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.820505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.821014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.821457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.821672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.823390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.833570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 795/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.836950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 801/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.839998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.840146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.851479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe718d9-0430-4a1d-a41d-a98335b3d8c3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.853289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520e6aa-cc57-41da-9a56-0486ba4589b3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.856953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.856953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.857203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.857367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.858110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.859698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.862499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.863111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.863392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.863681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.864485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.867405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.876493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 796/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.876493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.887673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 802/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.887673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.896715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9449b5-00d5-44f2-a737-569e4a7bf17f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.902020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.906367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.906367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.906367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.906367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.906367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.907133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ea332-f2ea-4653-98bc-7cff70984b2d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.911313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.912445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.912720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.913063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.913930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.915628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.923485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 803/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.923485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.932548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 797/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.937050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.937189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed66d-6ab6-4b4f-884c-432af0aa39a8 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.940510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.941213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.941549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.941802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] PATH_INFO: `/v3/projects/f45ecb3f4ffb493187eb8234ed2d86b5/users/31546ee1fdaa4094b3041a3723a200b2/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.944160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c516bd0-231f-46cc-829d-e56ae46cf300 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.951646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.952871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.954023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.954648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:24.955296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.957027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.957460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45ecb3f4ffb493187eb8234ed2d86b5, user_id=31546ee1fdaa4094b3041a3723a200b2, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:24.960182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:24.967970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 798/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:24.971103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:24.982561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a60e5-5b7f-4c2a-947a-0dc2be2b3250 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:24.987324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:24.987961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:24.988237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:24.988566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] PATH_INFO: `/v3/projects/4da51a52dda7469c91999f3023128568/users/e5547ff9dacf44da9d215a41e810d7e5/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.004982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da51a52dda7469c91999f3023128568, user_id=e5547ff9dacf44da9d215a41e810d7e5, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:25.007970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:25.070919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 804/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:24 2022] PUT /identity/v3/projects/f45ecb3f4ffb493187eb8234ed2d86b5/users/31546ee1fdaa4094b3041a3723a200b2/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.072053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:25.124233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 799/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:24 2022] PUT /identity/v3/projects/4da51a52dda7469c91999f3023128568/users/e5547ff9dacf44da9d215a41e810d7e5/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.125211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:25.155102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23bf5c-47bb-4381-b9dd-23c80a020456 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:25.208034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11bc0-cd5c-4c97-a22f-f6ac17d90009 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:25.212922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:25.213596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.213880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.214253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] PATH_INFO: `/v3/projects/fb1db26a0a414f9098fe100d3e6a8448/users/8cff9f3af7e54ae0b83b8651500a3d6f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.243910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.248297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1db26a0a414f9098fe100d3e6a8448, user_id=8cff9f3af7e54ae0b83b8651500a3d6f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:25.250665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:25.252046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:25.252179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.252179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.254081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] PATH_INFO: `/v3/projects/2e04720617934fdb873bef90a0b10979/users/4428117ca9564d6db9a638c888127223/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.271995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e04720617934fdb873bef90a0b10979, user_id=4428117ca9564d6db9a638c888127223, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:25.274866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:25.277188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.338950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 800/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:25 2022] PUT /identity/v3/projects/fb1db26a0a414f9098fe100d3e6a8448/users/8cff9f3af7e54ae0b83b8651500a3d6f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.339772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:25.397160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 805/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:25 2022] PUT /identity/v3/projects/2e04720617934fdb873bef90a0b10979/users/4428117ca9564d6db9a638c888127223/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.397856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:25.404478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7aa9e-e8d4-4687-86cf-60d3e28b9481 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:25.468809 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:25.469639 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.470158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.470756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] PATH_INFO: `/v3/projects/23195800a3994f8cb5dd3ad895de6d6f/users/74202305b1f24ad78b87f1a420d74aee/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.472028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38b40a-07ff-4f6d-babb-e974349410ed admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:25.477410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:25.478205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.478441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.478741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] PATH_INFO: `/v3/projects/e8b1631d32a8457ab4d83c567048dbe9/users/9257312362f343b88f4105df5d75c0cf/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.489278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23195800a3994f8cb5dd3ad895de6d6f, user_id=74202305b1f24ad78b87f1a420d74aee, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:25.492612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488d470-47e1-421a-acb3-0b360e0d4b37 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:25.494918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b1631d32a8457ab4d83c567048dbe9, user_id=9257312362f343b88f4105df5d75c0cf, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:25.497767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b46a0-4111-4cb2-b69b-a98f875cf74f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:25.579411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 806/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:25 2022] PUT /identity/v3/projects/e8b1631d32a8457ab4d83c567048dbe9/users/9257312362f343b88f4105df5d75c0cf/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.583219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008052-5689-4871-92a4-5da968973f27 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.583219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008052-5689-4871-92a4-5da968973f27 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.583219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008052-5689-4871-92a4-5da968973f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.592242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 801/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:25 2022] PUT /identity/v3/projects/23195800a3994f8cb5dd3ad895de6d6f/users/74202305b1f24ad78b87f1a420d74aee/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:25.594181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4b174-5ac2-4adc-aaaf-79e8a1a01005 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.594754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4b174-5ac2-4adc-aaaf-79e8a1a01005 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.595285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4b174-5ac2-4adc-aaaf-79e8a1a01005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.646749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c7008052-5689-4871-92a4-5da968973f27 None None] MFA Rules not processed for user `31546ee1fdaa4094b3041a3723a200b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.646749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c7008052-5689-4871-92a4-5da968973f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.654231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c6f4b174-5ac2-4adc-aaaf-79e8a1a01005 None None] MFA Rules not processed for user `e5547ff9dacf44da9d215a41e810d7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.656012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6f4b174-5ac2-4adc-aaaf-79e8a1a01005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.727221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 807/1608] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:25.729013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51223d7-9165-420b-9015-d834e74791ca None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.729013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51223d7-9165-420b-9015-d834e74791ca None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.729381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51223d7-9165-420b-9015-d834e74791ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.745373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 802/1609] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:25.750260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea5bb-a8c7-43d7-9643-882a4361e69e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.750482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea5bb-a8c7-43d7-9643-882a4361e69e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.750752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea5bb-a8c7-43d7-9643-882a4361e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.760895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d51223d7-9165-420b-9015-d834e74791ca None None] MFA Rules not processed for user `8cff9f3af7e54ae0b83b8651500a3d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.762292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d51223d7-9165-420b-9015-d834e74791ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.770523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a9eea5bb-a8c7-43d7-9643-882a4361e69e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.772340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a9eea5bb-a8c7-43d7-9643-882a4361e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.777130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.844149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.858251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 808/1610] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:25.859706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.860040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.860720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.878553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 803/1611] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:25.879921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:25.880213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:25.896717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:25.897149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] MFA Rules not processed for user `74202305b1f24ad78b87f1a420d74aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.898424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.933085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] MFA Rules not processed for user `9257312362f343b88f4105df5d75c0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:25.934332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:25.984141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 809/1612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:25.986006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.000847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479d82-bf76-4b10-8ca6-6ed6c68756dc None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.008471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.021259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.021259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.021259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.021259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.021259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.054609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 804/1613] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:26.054609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.070686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c06eda-94de-445e-9153-8687c5d445c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.075902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.076524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.076839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.077115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.077847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.080151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84426c-9bd6-4f14-bcbd-9d478d1586ae admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.105054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 810/1614] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:25 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.106297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.108615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:26.165305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9bf03-74f9-4b2a-99fa-08a181e2072a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.169162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.169845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.170172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.170443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.223780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 805/1615] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.226469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a608-f138-4c85-9a79-1a336d8aefc3 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.227042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a608-f138-4c85-9a79-1a336d8aefc3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.227747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621a608-f138-4c85-9a79-1a336d8aefc3 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.230270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 806/1616] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 03:46:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:26.231194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a608-f138-4c85-9a79-1a336d8aefc3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.256154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.258245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf329773-b73a-4314-a97f-030e5205da17 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.269965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 811/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:26.271529 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff845b1-fbb1-4fa1-a6ae-db3f9369d2f9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.279264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff845b1-fbb1-4fa1-a6ae-db3f9369d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.279264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff845b1-fbb1-4fa1-a6ae-db3f9369d2f9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.279264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 812/1618] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 24 03:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:26.279264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff845b1-fbb1-4fa1-a6ae-db3f9369d2f9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.345311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621a608-f138-4c85-9a79-1a336d8aefc3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.352429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.353045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.353319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.353585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.354977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.357067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.366943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff845b1-fbb1-4fa1-a6ae-db3f9369d2f9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.371863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.372712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.373348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.373348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.375018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.376340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee4ced-a0bc-45aa-8d99-40ec09e2309e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.458540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 807/1619] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/projects => generated 407 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.460080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.499438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 813/1620] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.500761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.501052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.502051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.558563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa1841-5cce-4d3a-9604-851af3c11bcb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.564077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.564880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.565217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.568400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.568400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.569785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02001775-864a-4074-ac81-2c5da9c41b04 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.594691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:26.596153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:26.646901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:26.672805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 808/1621] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.672805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.672805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.672805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.729415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:26.732105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:26.740001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 814/1622] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:26.750361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.763739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 809/1623] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:26.763739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.774689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b91edc-73d9-4d5f-b6fc-5508dd4eb6f8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.776032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad7af-b942-4757-a315-90405fdb8787 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.780859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.781470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.781748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.782052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.784126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.784317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.785887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.786110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.786372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.786673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.790016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.793439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.801297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 810/1624] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:26.802755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.814229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518297-c3f5-43db-8b8f-de7d21574486 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.818998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.819595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.819875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.820154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.820795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.823180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.837732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 811/1625] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:26.837732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.848059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae72f4-4aee-4c96-b569-9108da909a33 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.855738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.856771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.856771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.857119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.922322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 815/1626] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:26 2022] POST /identity/v3/users => generated 310 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:26.923474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:26.948901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:26.951330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04682-71a1-4d24-9dee-bd8ba00236a3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:26.952467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:26.967263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:26.968003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:26.968287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:26.968557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:26.978129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 812/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:26.980554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.007820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e34622-8084-4456-902b-5b46b3577f6d service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.019164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.019848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.020131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.021989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] PATH_INFO: `/v3/projects/21408f86ec8a4e379a96181f69fe30c5/users/59c6fd155d824c4ba2fd89c23faf368c/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.059330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21408f86ec8a4e379a96181f69fe30c5, user_id=59c6fd155d824c4ba2fd89c23faf368c, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.068540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.094556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.096833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.112640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 816/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:27.113631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.116316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:27.129778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8e6af-cd18-45e4-986f-10770b09bf0b service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.136332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.137399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.137662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.137958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] PATH_INFO: `/v3/projects/771fb4a3c00f47f3bb030ee505e064af/users/3bfdf6b3745d4858a0cc961645a21de3/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.153369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 813/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:26 2022] PUT /identity/v3/projects/21408f86ec8a4e379a96181f69fe30c5/users/59c6fd155d824c4ba2fd89c23faf368c/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:27.154328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.185368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] RBAC: Authorizing `identity:create_grant(project_id=771fb4a3c00f47f3bb030ee505e064af, user_id=3bfdf6b3745d4858a0cc961645a21de3, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.190515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.285116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 817/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:27 2022] PUT /identity/v3/projects/771fb4a3c00f47f3bb030ee505e064af/users/3bfdf6b3745d4858a0cc961645a21de3/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:27.286225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.303917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8c61-8a07-459e-af33-0fcb1cdff376 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.458095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.459012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.459380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.460108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.460878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.462797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.479182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 814/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:27.479182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.491164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f8ef9-b812-425e-b591-fad2a2ce4bd6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.495090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127262e-1c4f-4780-825b-a91596af910c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.497093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.497967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.498922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.498922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.501611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.505207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea3f6-6468-41b7-8c25-4d31d08a5884 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.508774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.510121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.510631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.511079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.511947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.513842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.523820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 815/1632] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:27.525890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32b3a-7ee2-4157-8e78-f726f1642462 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.525890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32b3a-7ee2-4157-8e78-f726f1642462 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.525890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32b3a-7ee2-4157-8e78-f726f1642462 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.531491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 816/1633] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 03:46:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:27.532375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32b3a-7ee2-4157-8e78-f726f1642462 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.541558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 818/1634] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:27.543600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.548835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32b3a-7ee2-4157-8e78-f726f1642462 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.562819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.565510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.565871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.566955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] PATH_INFO: `/v3/projects/f690b1917c2c4144b6be052b018eb21f/users/50535c24e6cf4ecfa538dde11ff679c4/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.573312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde75e7-82d8-4728-be8c-2e39dd739671 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.583881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.586289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.587211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.587607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] PATH_INFO: `/v3/projects/771fb4a3c00f47f3bb030ee505e064af/users/3bfdf6b3745d4858a0cc961645a21de3/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.590300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f690b1917c2c4144b6be052b018eb21f, user_id=50535c24e6cf4ecfa538dde11ff679c4, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.597014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.597139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771fb4a3c00f47f3bb030ee505e064af, user_id=3bfdf6b3745d4858a0cc961645a21de3, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.606781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de658f-f7b2-467a-994c-1d48e0cf13c9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.659202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 819/1635] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:27 2022] PUT /identity/v3/projects/771fb4a3c00f47f3bb030ee505e064af/users/3bfdf6b3745d4858a0cc961645a21de3/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:27.660826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdfc5-8669-40cb-9137-70accdb1bb9f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.661118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdfc5-8669-40cb-9137-70accdb1bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.661399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdfc5-8669-40cb-9137-70accdb1bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.713716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b94bdfc5-8669-40cb-9137-70accdb1bb9f None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:27.715011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b94bdfc5-8669-40cb-9137-70accdb1bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:27.728335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 817/1636] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:27 2022] PUT /identity/v3/projects/f690b1917c2c4144b6be052b018eb21f/users/50535c24e6cf4ecfa538dde11ff679c4/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:27.735471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.811501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 820/1637] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:46:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:27.813003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461a1b-07b6-41b7-954d-5a46e24175c1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.813292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461a1b-07b6-41b7-954d-5a46e24175c1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.813568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461a1b-07b6-41b7-954d-5a46e24175c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.829605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b980-554c-435b-b852-b0f8bea98e7a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:27.837393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:27.838158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:27.838446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:27.838719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] PATH_INFO: `/v3/projects/21408f86ec8a4e379a96181f69fe30c5/users/59c6fd155d824c4ba2fd89c23faf368c/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:27.841074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21408f86ec8a4e379a96181f69fe30c5, user_id=59c6fd155d824c4ba2fd89c23faf368c, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:27.844088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:27.860325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 818/1638] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:27 2022] PUT /identity/v3/projects/21408f86ec8a4e379a96181f69fe30c5/users/59c6fd155d824c4ba2fd89c23faf368c/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:27.861200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:27.886083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5d461a1b-07b6-41b7-954d-5a46e24175c1 None None] MFA Rules not processed for user `3bfdf6b3745d4858a0cc961645a21de3`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:27.889056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5d461a1b-07b6-41b7-954d-5a46e24175c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:27.924195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:28.008799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8d7d0-dc4f-4886-98cc-8a64b6e4c573 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:28.024114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:28.024895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.025279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.025655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.026470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:28.036626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a07e-716a-4a64-a093-7d5e8f233317 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:28.043071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 821/1639] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:28.043071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3cf5-bdf3-4c0d-816d-93843b6c538d None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.043071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3cf5-bdf3-4c0d-816d-93843b6c538d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.043071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3cf5-bdf3-4c0d-816d-93843b6c538d None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.052955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 822/1640] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 03:46:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:28.054021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3cf5-bdf3-4c0d-816d-93843b6c538d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:28.071637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 819/1641] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:28.072837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555359-6824-4a6c-88c4-c3a34b533a04 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.073167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555359-6824-4a6c-88c4-c3a34b533a04 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.074022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4555359-6824-4a6c-88c4-c3a34b533a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.134237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f4555359-6824-4a6c-88c4-c3a34b533a04 None None] MFA Rules not processed for user `59c6fd155d824c4ba2fd89c23faf368c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:28.136358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f4555359-6824-4a6c-88c4-c3a34b533a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:28.436698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3cf5-bdf3-4c0d-816d-93843b6c538d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:28.436698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:28.436698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.436698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.437712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 820/1642] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:28.438127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:28.439013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:28.439013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:28.439329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 821/1643] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:46:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:28.439329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:28.439585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 823/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:28.439585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:28.439585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a517eb-14a6-4535-91b0-71d2ea4012f1 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:28.439585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:28.440017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.440017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.440017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] PATH_INFO: `/v3/projects/f690b1917c2c4144b6be052b018eb21f/users/50535c24e6cf4ecfa538dde11ff679c4/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.440334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0527a-097e-47c9-840c-e9719ac05f9f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:28.440406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f690b1917c2c4144b6be052b018eb21f, user_id=50535c24e6cf4ecfa538dde11ff679c4, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:28.440406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60be25-24c6-4310-9f6f-bb915124a222 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:28.440537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:28.440618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 824/1645] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:28 2022] PUT /identity/v3/projects/f690b1917c2c4144b6be052b018eb21f/users/50535c24e6cf4ecfa538dde11ff679c4/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:28.440688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.440688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.440688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.440864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.440864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.440864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.441053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:28.441053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:28.441053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 822/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:28.450374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] MFA Rules not processed for user `50535c24e6cf4ecfa538dde11ff679c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:28.451803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:28.575027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 825/1647] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:28.685016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:28.712882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:28.726467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc6a-9d59-41be-905a-379f19bb4e00 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:28.824420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:28.826378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:28.831701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:28.832360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:28.954539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:28.956151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:28.987581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 823/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:29.142894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:29.157245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32aaf9-fe76-4d48-9eee-18163639c122 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:29.165890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:29.166554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:29.166838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:29.167120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:29.299687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:29.301562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:29.314578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 826/1649] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:29.508364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:29.728855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:29.750834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39115-a3ea-4c0d-b1cd-7440abb2361a service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:29.755433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:29.757025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:29.757553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:29.760025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:29.780933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:29.782750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:29.810050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 824/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:29 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:29.826443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:30.679363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:30.697905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107603f-81da-4ff5-90a5-347a39a24bfa service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:30.710241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:30.710842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:30.711129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:30.711404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:30.819923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:30.855490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:30.859630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:30.882746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 827/1651] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:30.911753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:30.922484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161e4a4-9ba7-4290-addc-39cb3c87ffa9 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:30.938060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:30.938699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:30.938982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:30.939258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:31.073326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:31.075354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee16e-59f4-4a25-9602-49935d4c57e8 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:31.116508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 825/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:31.130186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:32.865763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:33.006110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8362a3-66fd-4b2c-9977-7bbec586bd15 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:33.022747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:33.023488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:33.023970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:33.024437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] PATH_INFO: `/v3/users/e5547ff9dacf44da9d215a41e810d7e5` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:33.026355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5547ff9dacf44da9d215a41e810d7e5)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:33.038660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:33.080496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:33.305038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5547ff9dacf44da9d215a41e810d7e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:33.306740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5547ff9dacf44da9d215a41e810d7e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:33.340594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5547ff9dacf44da9d215a41e810d7e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:33.351482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5547ff9dacf44da9d215a41e810d7e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:33.375545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5547ff9dacf44da9d215a41e810d7e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:33.495704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:32 2022] DELETE /identity/v3/users/e5547ff9dacf44da9d215a41e810d7e5 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:33.497622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:33.498129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:33.498199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:33.561629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:33.563429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:33.743032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 826/1654] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:33.787474 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:33.789301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:33.985681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd989519-a657-4bec-8eb3-db65a9d20429 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:33.985681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:33.985681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:33.985681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:33.987509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:34.003464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:34.005453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef776f2-b15b-43b7-9cef-bc4bb35a7829 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:34.031207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 829/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:34.379024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:34.381839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:34.414210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3faf7-f46c-4a00-807c-bb40b5d33b88 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:34.458119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:34.459239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:34.465028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:34.465432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] PATH_INFO: `/v3/users/9257312362f343b88f4105df5d75c0cf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:34.473660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9257312362f343b88f4105df5d75c0cf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:34.473660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: WARNING py.warnings [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:34.473660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: warnings.warn(msg) Aug 24 03:46:34.473660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: Aug 24 03:46:34.480982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:34.870332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9257312362f343b88f4105df5d75c0cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:34.894254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9257312362f343b88f4105df5d75c0cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:34.895940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9257312362f343b88f4105df5d75c0cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:34.897625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9257312362f343b88f4105df5d75c0cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:35.048127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9257312362f343b88f4105df5d75c0cf'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:35.071576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:35.099212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 827/1656] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:34 2022] DELETE /identity/v3/users/9257312362f343b88f4105df5d75c0cf => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:35.104483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd3fa-2979-4f0d-a52e-2d0e83242249 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:35.105441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd3fa-2979-4f0d-a52e-2d0e83242249 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:35.105860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cd3fa-2979-4f0d-a52e-2d0e83242249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:35.130979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-904cd3fa-2979-4f0d-a52e-2d0e83242249 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:35.133127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-904cd3fa-2979-4f0d-a52e-2d0e83242249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:35.254118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 830/1657] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:35.297329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:35.299544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:35.589480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a76-f608-496a-9b0f-fc13dea38ea2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:35.596131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:35.597107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:35.600823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:35.602388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:35.630471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:35.634817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:35.653577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 828/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:35.833145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223408c-93ed-40f7-9651-f0fd9c828f3a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:35.834248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223408c-93ed-40f7-9651-f0fd9c828f3a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:35.835190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223408c-93ed-40f7-9651-f0fd9c828f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:36.007209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:36.012742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.064090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0223408c-93ed-40f7-9651-f0fd9c828f3a None None] MFA Rules not processed for user `14e8865cb1b84e4b89978ba735ec2037`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:36.074713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0223408c-93ed-40f7-9651-f0fd9c828f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.088631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661b76e-8138-4a4b-89fa-6febba4b6554 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:36.124996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:36.129558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:36.132406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:36.133519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] PATH_INFO: `/v3/projects/4da51a52dda7469c91999f3023128568` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:36.146029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da51a52dda7469c91999f3023128568)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:36.157350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:36.224204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:36.349147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 831/1659] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:36.366678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a266ad-aa6a-47bc-b162-6a76827ce0e7 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:36.369433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a266ad-aa6a-47bc-b162-6a76827ce0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:36.370315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a266ad-aa6a-47bc-b162-6a76827ce0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:36.435275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-84a266ad-aa6a-47bc-b162-6a76827ce0e7 None None] MFA Rules not processed for user `14e8865cb1b84e4b89978ba735ec2037`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:36.452353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-84a266ad-aa6a-47bc-b162-6a76827ce0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.456520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da51a52dda7469c91999f3023128568', 'request_id': 'req-61e45c7d-6526-455a-a84d-becdaeafbf86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:36.481221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da51a52dda7469c91999f3023128568', 'request_id': 'req-61e45c7d-6526-455a-a84d-becdaeafbf86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:36.506967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da51a52dda7469c91999f3023128568', 'request_id': 'req-61e45c7d-6526-455a-a84d-becdaeafbf86'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:36.577618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 832/1660] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:36.583552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca060-4c81-47a1-a92f-07d6cbe05dd8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:36.584504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca060-4c81-47a1-a92f-07d6cbe05dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:36.584918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca060-4c81-47a1-a92f-07d6cbe05dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:36.606826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] The token cache is being invalidate because project 4da51a52dda7469c91999f3023128568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:36.606826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:36.613050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:36.622371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 829/1661] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:36 2022] DELETE /identity/v3/projects/4da51a52dda7469c91999f3023128568 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:46:36.624175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:36.644728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3c7ca060-4c81-47a1-a92f-07d6cbe05dd8 None None] MFA Rules not processed for user `8947c9cf75d642c88f1dc2f4382025bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:36.647550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3c7ca060-4c81-47a1-a92f-07d6cbe05dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.652472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.859807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45c7d-6526-455a-a84d-becdaeafbf86 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:36.884413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:36.885247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:36.885632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:36.887329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:36.890741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:36.940554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:36.942814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:36.956286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 830/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:36.957447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:36.962702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.006600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 833/1663] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:37.017217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:37.017504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:37.017781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:37.101420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] MFA Rules not processed for user `8947c9cf75d642c88f1dc2f4382025bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:37.103124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.124743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b8ab-9f2c-4679-851c-301f5d849969 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:37.134684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:37.134684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:37.134684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:37.134684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] PATH_INFO: `/v3/users/3bfdf6b3745d4858a0cc961645a21de3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:37.135966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfdf6b3745d4858a0cc961645a21de3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:37.138796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 834/1664] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:37.143468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:37.145494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:37.152193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.226978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1945e9a-bfe7-433d-b74f-36df2e4d910c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:37.243312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:37.244122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:37.244537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:37.245016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] PATH_INFO: `/v3/projects/e8b1631d32a8457ab4d83c567048dbe9` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:37.246621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b1631d32a8457ab4d83c567048dbe9)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:37.249863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: WARNING py.warnings [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:37.249863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: warnings.warn(msg) Aug 24 03:46:37.249863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: Aug 24 03:46:37.251113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:37.452690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfdf6b3745d4858a0cc961645a21de3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.473770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfdf6b3745d4858a0cc961645a21de3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.476916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfdf6b3745d4858a0cc961645a21de3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.477661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfdf6b3745d4858a0cc961645a21de3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.516082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b1631d32a8457ab4d83c567048dbe9', 'request_id': 'req-95acd29e-757c-45c9-a0be-4c8e5bda3e93'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.606659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfdf6b3745d4858a0cc961645a21de3'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.668119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 831/1665] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:36 2022] DELETE /identity/v3/users/3bfdf6b3745d4858a0cc961645a21de3 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:37.672276 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:37.675063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b1631d32a8457ab4d83c567048dbe9', 'request_id': 'req-95acd29e-757c-45c9-a0be-4c8e5bda3e93'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.683854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.717563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b1631d32a8457ab4d83c567048dbe9', 'request_id': 'req-95acd29e-757c-45c9-a0be-4c8e5bda3e93'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.753668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] The token cache is being invalidate because project e8b1631d32a8457ab4d83c567048dbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:37.754229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.757028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95acd29e-757c-45c9-a0be-4c8e5bda3e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:37.759778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 835/1666] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:37 2022] DELETE /identity/v3/projects/e8b1631d32a8457ab4d83c567048dbe9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:37.764920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6201f-df01-4be8-9bec-742a3973d863 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:37.769914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6201f-df01-4be8-9bec-742a3973d863 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:37.772049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6201f-df01-4be8-9bec-742a3973d863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:37.808879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-08e6201f-df01-4be8-9bec-742a3973d863 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:37.810980 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-08e6201f-df01-4be8-9bec-742a3973d863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.882002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4242fd-ffbd-47f6-a63c-e28cbf4999af admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:37.889689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:37.890636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:37.891092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:37.891544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:37.897697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:37.930704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:38.002009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 836/1667] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:38.008180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.008699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.009120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.049137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:38.050806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:38.062951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 837/1668] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:38.067230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.105782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.107595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.115798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7afce-46b8-4042-b601-5a211f3a8f21 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.129455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 832/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:38.153329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.155100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.155666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.157654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.158778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:38.159745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.166778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0debf-3dce-4789-9c2e-06b747b5142c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.195731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 838/1670] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:46:38.199888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.232211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0313d8-35cc-4c1f-acb5-58ba36cb4663 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.243477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.247579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.247579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.247579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.247879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.249610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.262977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a848d9-50fa-4cb9-80f6-88683083967f None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.263851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a848d9-50fa-4cb9-80f6-88683083967f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.264280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a848d9-50fa-4cb9-80f6-88683083967f None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.266660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 839/1671] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 03:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:38.274006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.276360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.276360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.418604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:38.429038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:38.466233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 833/1672] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:38 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:46:38.467391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.592086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 840/1673] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:38.593054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:38.665440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8be163-e590-4c2b-978f-e6a38e32b660 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.680110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.683125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.684299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.684299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.684470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.685228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.687021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:38.690387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf6062-c97e-4b0c-af91-58b17dbe37e8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.724491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa28dc3-f09b-47cd-a476-eb0f438d2e66 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.829498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.830411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.831022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.831507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.851244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.853744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.870979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 841/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:38.877159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 834/1675] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:38 2022] POST /identity/v3/users => generated 287 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:38.882578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.904571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f598-be1b-4ba2-b658-4488a6bd2e91 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.925216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.925860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.928861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.928861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.928861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.930497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:38.934040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d944-9004-4fc7-8be7-f01b247bab6a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.934304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d944-9004-4fc7-8be7-f01b247bab6a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.934777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45d944-9004-4fc7-8be7-f01b247bab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.951516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 842/1676] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:38.953449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:38.968536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24352b-3bff-4815-b4ec-8db9b943e6d4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:38.980560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:38.981238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:38.981361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ec45d944-9004-4fc7-8be7-f01b247bab6a None None] MFA Rules not processed for user `4428117ca9564d6db9a638c888127223`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:38.981521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:38.983185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:38.986212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec45d944-9004-4fc7-8be7-f01b247bab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:38.986323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:38.987075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4f04-b09f-4cc9-af56-788e66dece32 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:39.008433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 843/1677] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:39.010949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98f5a6-23c2-4989-9d89-4fd871a42276 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.011262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98f5a6-23c2-4989-9d89-4fd871a42276 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.011871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98f5a6-23c2-4989-9d89-4fd871a42276 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.017981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 844/1678] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 24 03:46:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:39.019449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98f5a6-23c2-4989-9d89-4fd871a42276 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:39.070717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98f5a6-23c2-4989-9d89-4fd871a42276 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:39.082654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:39.084275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.084580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.085051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] PATH_INFO: `/v3/projects/7a4fdf6461de4779819a19065d51994d/users/371d0c68a2554e39851e056a19f0be38/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.119445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4fdf6461de4779819a19065d51994d, user_id=371d0c68a2554e39851e056a19f0be38, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:39.129564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 835/1679] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:39.129564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.129564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.129564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.134617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b011-5b76-461f-9727-71353606e38e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:39.167419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:39.168931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:39.177570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 836/1680] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:46:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:39.223129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:39.236244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534012-00d2-476f-b89f-ec6bb84ceed2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:39.242508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:39.243494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.243912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.247396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.260857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:39.262933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:39.272815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 845/1681] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:39 2022] PUT /identity/v3/projects/7a4fdf6461de4779819a19065d51994d/users/371d0c68a2554e39851e056a19f0be38/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:39.282106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 837/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:39.286919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.288198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.288614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.320124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] MFA Rules not processed for user `371d0c68a2554e39851e056a19f0be38`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:39.323902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:39.393029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 846/1683] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:39.453761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:39.455198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:39.483249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942d50-fb2b-43f5-9704-6d147c8f7823 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:39.596193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:39.596894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.597218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.597613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] PATH_INFO: `/v3/projects/771fb4a3c00f47f3bb030ee505e064af` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.599038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771fb4a3c00f47f3bb030ee505e064af)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:39.602860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:39.761997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771fb4a3c00f47f3bb030ee505e064af', 'request_id': 'req-df9e6856-a84e-4ef9-adf2-b387d2754c69'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:39.779585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771fb4a3c00f47f3bb030ee505e064af', 'request_id': 'req-df9e6856-a84e-4ef9-adf2-b387d2754c69'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:39.796008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771fb4a3c00f47f3bb030ee505e064af', 'request_id': 'req-df9e6856-a84e-4ef9-adf2-b387d2754c69'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:39.807107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:39.808884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:39.926620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cfe48-69dd-4fea-ba36-d1c74864428c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:39.933785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] The token cache is being invalidate because project 771fb4a3c00f47f3bb030ee505e064af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:39.934692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:39.935667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-df9e6856-a84e-4ef9-adf2-b387d2754c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:39.937926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 838/1684] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:39 2022] DELETE /identity/v3/projects/771fb4a3c00f47f3bb030ee505e064af => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:39.939536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf2bf-a56c-4cf2-bb29-49568e5c2cb2 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.939896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf2bf-a56c-4cf2-bb29-49568e5c2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.940245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf2bf-a56c-4cf2-bb29-49568e5c2cb2 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.949614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 839/1685] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 24 03:46:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:39.949818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f7d-9d03-4cdc-83d4-6bef8b106485 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:39.950120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f7d-9d03-4cdc-83d4-6bef8b106485 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:39.950404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f7d-9d03-4cdc-83d4-6bef8b106485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:39.981235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b0955f7d-9d03-4cdc-83d4-6bef8b106485 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:39.985920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b0955f7d-9d03-4cdc-83d4-6bef8b106485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.105194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.105886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.106308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.106623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.113710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.169967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 840/1686] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:40.172083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000ad2-4c64-4580-849b-8d0c8d40d290 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.172756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000ad2-4c64-4580-849b-8d0c8d40d290 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.173162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000ad2-4c64-4580-849b-8d0c8d40d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.225302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.226303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7d000ad2-4c64-4580-849b-8d0c8d40d290 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:40.227638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7d000ad2-4c64-4580-849b-8d0c8d40d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.310074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.312824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.333472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 847/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:40.335050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.338036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.399712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d647de-45f9-4768-8c61-f8b4542b39e8 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:40.407888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.408767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.409201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.409681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.414172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 841/1688] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 24 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:40.415475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.415597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.416082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.416450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.432279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:40.464238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:40.467655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.486969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 842/1689] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:40.488115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.493258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.543626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f3c64-c562-4da0-8f9a-4a39d4cf4096 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:40.565694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.566454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.566735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.568872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.570873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.571164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.575240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:40.592346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 848/1690] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:40.593328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.619975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.631786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.652751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bdabf-a0e0-4ad8-9c5e-e2712ab88a41 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:40.663091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 843/1691] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:40.664539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.665008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.665511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.665956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.666342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.679608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c679b-ad36-49f7-b418-b7caa744533e service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:40.685435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.686318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.687350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.688209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.690223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:40.690681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.695952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.707194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.711790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.736862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 849/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:40.754208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 844/1693] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:40.757457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.770079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e90229-4280-4308-ad02-c34a036c9755 service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:40.776157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:40.777029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:40.777742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:40.778166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:40.778907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:40.781173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcd667-e986-4176-8494-0c2fdca48793 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:40.895770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 850/1694] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:40 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:40.901333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:40.922213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31ba59-7fae-425c-bc45-057225dc46a9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:41.070557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:41.074179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:41.074179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:41.121612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] MFA Rules not processed for user `8947c9cf75d642c88f1dc2f4382025bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:41.123573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:41.196483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:41.196974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:41.196974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:41.197125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:41.197784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:41.216679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:41.378777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 851/1695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:41.380488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:41.402113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 845/1696] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:40 2022] POST /identity/v3/users => generated 279 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:46:41.406264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:41.413182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:41.438149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36090-8ce5-44d2-96c6-474598faa52f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:41.456599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:41.456599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:41.456599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:41.456599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:41.459093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:41.459093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:41.466224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516b44-de73-49ed-86cf-66a49c8e14eb None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:41.476055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:41.476852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:41.477137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:41.477411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] PATH_INFO: `/v3/users/8cff9f3af7e54ae0b83b8651500a3d6f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:41.480050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cff9f3af7e54ae0b83b8651500a3d6f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:41.482282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:41.504122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 846/1697] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:46:41.505523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:41.514122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:41.539487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4f988-7303-47b3-83c0-625719b41a9e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:41.544963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:41.545664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:41.545976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:41.546254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] PATH_INFO: `/v3/users/371d0c68a2554e39851e056a19f0be38` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:41.548825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371d0c68a2554e39851e056a19f0be38)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:41.551736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:41.793208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cff9f3af7e54ae0b83b8651500a3d6f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.794315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cff9f3af7e54ae0b83b8651500a3d6f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.809497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cff9f3af7e54ae0b83b8651500a3d6f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.810912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cff9f3af7e54ae0b83b8651500a3d6f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.848237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cff9f3af7e54ae0b83b8651500a3d6f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.861709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371d0c68a2554e39851e056a19f0be38'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.875031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371d0c68a2554e39851e056a19f0be38'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.876490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371d0c68a2554e39851e056a19f0be38'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.878678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371d0c68a2554e39851e056a19f0be38'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:41.949002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:41 2022] DELETE /identity/v3/users/8cff9f3af7e54ae0b83b8651500a3d6f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:41.949901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:41.952725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.010473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c3ed2635-ec69-4808-9b66-019b3ddf53e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371d0c68a2554e39851e056a19f0be38'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.066123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 847/1699] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:41 2022] DELETE /identity/v3/users/371d0c68a2554e39851e056a19f0be38 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:42.067433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae06d6-d46d-4f3e-9ea7-1177df2191ac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.080816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae06d6-d46d-4f3e-9ea7-1177df2191ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.083874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae06d6-d46d-4f3e-9ea7-1177df2191ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.159844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-02ae06d6-d46d-4f3e-9ea7-1177df2191ac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:42.161305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-02ae06d6-d46d-4f3e-9ea7-1177df2191ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.218748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236cdf-d9f4-4c69-925f-4114508ebee4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:42.331036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 848/1700] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:42.334930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.334930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.334930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.387737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:42.389025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.410597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 849/1701] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:42.411581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:42.414011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.447943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c35e0-1ec0-4ba0-84bc-a6f11a4b71e6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:42.467202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:42.468065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.470303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.470818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] PATH_INFO: `/v3/users/74202305b1f24ad78b87f1a420d74aee` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.473140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=74202305b1f24ad78b87f1a420d74aee)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:42.473559 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:42.477238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.477238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.477238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.477238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:42.478485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:42.481819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:42.525422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 853/1702] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 576 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:42.530410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:42.531983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.612791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:42.645252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa583e3-4efe-4438-8c89-e7b6767c8698 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:42.668952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:42.669624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.669911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.672725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.695387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:42.702707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:42.750364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 854/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:42.751667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:42.785415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74202305b1f24ad78b87f1a420d74aee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.791911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683433a9-a716-4f60-b82f-9c0ce702f89e service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:42.803222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:42.805183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.805626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.806757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.807475 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74202305b1f24ad78b87f1a420d74aee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.811467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74202305b1f24ad78b87f1a420d74aee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.813308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74202305b1f24ad78b87f1a420d74aee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.833318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:42.836733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:42.856847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 855/1704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:42.858345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:42.859962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:42.925745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd33e58-0218-4e9d-a8c3-8d313d7cfdda service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:42.940438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:42.941140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:42.941423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:42.941702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] PATH_INFO: `/v3/projects/fe87377a2748439092cc2e3fb60cbdbf/users/498d1d25b28e40178e4e872874d63458/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:42.974152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3763da6c-ebd2-4af1-92ae-8b16ecd56ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74202305b1f24ad78b87f1a420d74aee'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:42.991913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe87377a2748439092cc2e3fb60cbdbf, user_id=498d1d25b28e40178e4e872874d63458, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:42.995530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfed466-fa9b-4002-b522-71c260e16c30 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:43.010606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 850/1705] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:42 2022] DELETE /identity/v3/users/74202305b1f24ad78b87f1a420d74aee => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:43.019757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:43.020307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:43.021195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:43.065970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:43.067339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:43.118220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:43.136688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 856/1706] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:42 2022] PUT /identity/v3/projects/fe87377a2748439092cc2e3fb60cbdbf/users/498d1d25b28e40178e4e872874d63458/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:43.138384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:43.139310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:43.139602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:43.180893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] MFA Rules not processed for user `498d1d25b28e40178e4e872874d63458`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:43.182472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:43.253354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 851/1707] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:43.269021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:43.271064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:43.362063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 857/1708] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:43.368053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:43.369644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:43.462461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dbe75-5757-49ac-a61c-78049ca491ab None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:43.465713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f7a3e-3827-412a-b6c4-43f23dcbab1f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:43.475791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:43.476554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:43.476738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:43.477080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:43.478688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:43.490518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:43.654991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 858/1709] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:43 2022] POST /identity/v3/projects => generated 355 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:43.656572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:43.696223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:43.697521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:43.698154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:43.710158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:43.751766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:43.753497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:43.788444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 852/1710] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:43.848959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d043a2e-aa94-44bc-87c3-06e9f1c0f24a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:43.860694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:43.863918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:43.864692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:43.864982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:43.865728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:43.870373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:43.986126 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 859/1711] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:43 2022] POST /identity/v3/users => generated 284 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:43.986826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.000056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4312b8-cb0b-4d5c-a7e9-1f1ef831bb05 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.024792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.025640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.026173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.027018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.027895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.029864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.058560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 853/1712] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:46:44.064917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.085106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0780a-700a-4411-b4b9-6aa9fc3440ca admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.106954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.110549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.111035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.114647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] PATH_INFO: `/v3/projects/3fb693de6b464db389666f8e6ce52c25/users/00f2ea00df024b1d8be93985bb47cc5b/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.158556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb693de6b464db389666f8e6ce52c25, user_id=00f2ea00df024b1d8be93985bb47cc5b, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.166316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.174896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.177200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:44.223154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369987bd-f150-40fa-a56b-09eb31aac7fd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.230288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.231328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.231838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.232296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] PATH_INFO: `/v3/users/31546ee1fdaa4094b3041a3723a200b2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.248713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31546ee1fdaa4094b3041a3723a200b2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.251706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.315589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 860/1713] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:44 2022] PUT /identity/v3/projects/3fb693de6b464db389666f8e6ce52c25/users/00f2ea00df024b1d8be93985bb47cc5b/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:44.323940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.530467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba77a3c-61eb-4985-b41f-71e6ced4224f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.538212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.539024 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.539317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.539594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.541021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.548873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.565577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 861/1714] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:46:44.566661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.573106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:44.602078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843073e3-bdee-4e45-b1a9-42dba07c8b10 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.636199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.639082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.645755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.646145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] PATH_INFO: `/v3/projects/7a4fdf6461de4779819a19065d51994d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.650558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4fdf6461de4779819a19065d51994d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.652334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31546ee1fdaa4094b3041a3723a200b2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.656675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.667892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31546ee1fdaa4094b3041a3723a200b2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.671039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31546ee1fdaa4094b3041a3723a200b2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.673305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31546ee1fdaa4094b3041a3723a200b2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.768670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31546ee1fdaa4094b3041a3723a200b2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.806267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 854/1715] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:44 2022] DELETE /identity/v3/users/31546ee1fdaa4094b3041a3723a200b2 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:46:44.809129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.811571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:44.835755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4fdf6461de4779819a19065d51994d', 'request_id': 'req-334dda18-0ef8-4130-b45e-5df7a0a75fd5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.900519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:44.933520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4fdf6461de4779819a19065d51994d', 'request_id': 'req-334dda18-0ef8-4130-b45e-5df7a0a75fd5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.945723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4fdf6461de4779819a19065d51994d', 'request_id': 'req-334dda18-0ef8-4130-b45e-5df7a0a75fd5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.946693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed693252-f90b-45c1-b277-7cced5e7a153 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:44.957363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:44.958873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:44.961073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:44.961383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] PATH_INFO: `/v3/projects/fb1db26a0a414f9098fe100d3e6a8448` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:44.963523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1db26a0a414f9098fe100d3e6a8448)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:44.966080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:44.970752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] The token cache is being invalidate because project 7a4fdf6461de4779819a19065d51994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:44.971089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.972137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:44.974310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 862/1716] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:44 2022] DELETE /identity/v3/projects/7a4fdf6461de4779819a19065d51994d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:44.980387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:44.986110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.113206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dda18-0ef8-4130-b45e-5df7a0a75fd5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:45.119620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:45.120411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.120751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.121200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] PATH_INFO: `/v3/projects/3fb693de6b464db389666f8e6ce52c25/users/00f2ea00df024b1d8be93985bb47cc5b/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.123638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb693de6b464db389666f8e6ce52c25, user_id=00f2ea00df024b1d8be93985bb47cc5b, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:45.153249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67b8f-4bce-4d85-a74e-ce83626cda93 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:45.180370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 863/1717] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:44 2022] PUT /identity/v3/projects/3fb693de6b464db389666f8e6ce52c25/users/00f2ea00df024b1d8be93985bb47cc5b/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:45.184575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.184916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1db26a0a414f9098fe100d3e6a8448', 'request_id': 'req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.185017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.185380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.224283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1db26a0a414f9098fe100d3e6a8448', 'request_id': 'req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.234566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.236312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1db26a0a414f9098fe100d3e6a8448', 'request_id': 'req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.236465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.383937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] The token cache is being invalidate because project fb1db26a0a414f9098fe100d3e6a8448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:45.384237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.386195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f7ab4d9f-0001-4168-bac2-39f7a7c47fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.388202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 855/1718] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:44 2022] DELETE /identity/v3/projects/fb1db26a0a414f9098fe100d3e6a8448 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:45.393116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ffad-5fab-46f9-917f-107adaf5eb34 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.399167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ffad-5fab-46f9-917f-107adaf5eb34 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.399167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ffad-5fab-46f9-917f-107adaf5eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.431519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 864/1719] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.432435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:45.439515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.460638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4168ffad-5fab-46f9-917f-107adaf5eb34 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.461985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4168ffad-5fab-46f9-917f-107adaf5eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.466890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770287cd-9b4b-48f9-9236-5100e63c53dd None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:45.485237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:45.486200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.486200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.486370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:45.486588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] PATH_INFO: `/v3/projects/23195800a3994f8cb5dd3ad895de6d6f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.489378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23195800a3994f8cb5dd3ad895de6d6f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:45.491431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:45.494768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 856/1720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.496059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7b86-91d9-42a9-a439-d8b22c3f75e8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.496345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7b86-91d9-42a9-a439-d8b22c3f75e8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.496617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a7b86-91d9-42a9-a439-d8b22c3f75e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.579785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ba0a7b86-91d9-42a9-a439-d8b22c3f75e8 None None] MFA Rules not processed for user `00f2ea00df024b1d8be93985bb47cc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.581024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ba0a7b86-91d9-42a9-a439-d8b22c3f75e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.656057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 857/1721] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.657320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.657608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.657885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.678598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.680333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.696914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 858/1722] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.697914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:45.699386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.723045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23195800a3994f8cb5dd3ad895de6d6f', 'request_id': 'req-c9b0ecc5-bdcf-4940-ae73-54d208580169'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.761078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9ef5b-49e8-447c-9516-21418e49f270 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:45.815410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:45.816094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.816384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.816660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.849452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23195800a3994f8cb5dd3ad895de6d6f', 'request_id': 'req-c9b0ecc5-bdcf-4940-ae73-54d208580169'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.861038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23195800a3994f8cb5dd3ad895de6d6f', 'request_id': 'req-c9b0ecc5-bdcf-4940-ae73-54d208580169'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.873909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] The token cache is being invalidate because project 23195800a3994f8cb5dd3ad895de6d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:45.874023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.874722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c9b0ecc5-bdcf-4940-ae73-54d208580169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:45.877444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 865/1723] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:45 2022] DELETE /identity/v3/projects/23195800a3994f8cb5dd3ad895de6d6f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:45.879554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.879844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.880299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.903091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:45.904452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.905836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.910355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb5bfc-f6d9-4905-b27f-fca4128201de service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:45.919123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 866/1724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.920037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:45.921845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.931075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 859/1725] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:45.933927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:45.934702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:45.935121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:45.960488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:45.962056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.972760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 860/1726] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:45.973811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:45.975492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:45.988504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e44e5-e95e-4fb2-b987-4c9b920746e2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:45.990291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2a2bb-391f-43d8-8acb-569d9f05c942 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:45.994754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:45.995972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.000285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.000471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.000471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] PATH_INFO: `/v3/users/50535c24e6cf4ecfa538dde11ff679c4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.000638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.000839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50535c24e6cf4ecfa538dde11ff679c4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.000924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:46.001004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.069617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.071038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e537b-51db-43fc-8907-fb18a840647b service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.080539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 867/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:46.081857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.082176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.082455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.102690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] MFA Rules not processed for user `4428117ca9564d6db9a638c888127223`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:46.103961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:46.177992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 868/1728] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:46.179523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:46.199166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879cb2-fedf-4b15-97f2-3d57b166ee61 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:46.212743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.213386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.213666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.218292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.218292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:46.218292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.218292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.230673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 869/1729] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:46.231818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:46.246737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c0041-006a-4610-bdd2-994a4bb93347 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:46.253054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.253054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.253266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.253989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.255394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:46.255708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.258267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.283725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 870/1730] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:46.283725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:46.306937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfe0bf-e875-49f5-bebc-7e98b67c6249 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:46.337055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.338387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.338754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.339109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.343943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.349816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.371894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50535c24e6cf4ecfa538dde11ff679c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:46.392565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50535c24e6cf4ecfa538dde11ff679c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:46.393577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50535c24e6cf4ecfa538dde11ff679c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:46.394628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50535c24e6cf4ecfa538dde11ff679c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:46.536763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3f2e054e-0ad0-4c76-8a86-3b10e597c75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50535c24e6cf4ecfa538dde11ff679c4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:46.555739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 871/1731] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:46 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:46.568500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:46.570810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:46.590405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 861/1732] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:45 2022] DELETE /identity/v3/users/50535c24e6cf4ecfa538dde11ff679c4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:46.595508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.595803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.596073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.703123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e154ca-2248-4876-86c5-c4ed527c82b0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:46.744231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:46.745653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:46.848371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.849774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.850261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.850684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.852198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:46.855135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 862/1733] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:46.856111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:46.857092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:46.861092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:46.960644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4acd-2cb5-466c-8b40-44baa7234c76 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:46.969501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:46.970258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:46.970614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:46.971503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:46.974557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:46.986332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:47.045161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 872/1734] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:46 2022] POST /identity/v3/projects => generated 403 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:47.047945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.056362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:47.120637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:47.122093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:47.137769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 863/1735] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:47.138686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.142598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:47.172283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedb32a-3890-4fd7-96db-45d5c3ab7bd7 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:47.228693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f220-8368-402c-abcf-30ed62a8377c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:47.236404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:47.237443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:47.237443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:47.237658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:47.238234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:47.240190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:47.273447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:47.274148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:47.274433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:47.274707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] PATH_INFO: `/v3/projects/f45ecb3f4ffb493187eb8234ed2d86b5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:47.275982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45ecb3f4ffb493187eb8234ed2d86b5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:47.285158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:47.515653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 873/1736] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:47 2022] POST /identity/v3/users => generated 294 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:47.517534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.534650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45ecb3f4ffb493187eb8234ed2d86b5', 'request_id': 'req-17bcc35e-2b4c-4517-a5c1-741b55f70b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:47.534911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159e64-ee28-47c0-9f53-f260abfe73b6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:47.548504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45ecb3f4ffb493187eb8234ed2d86b5', 'request_id': 'req-17bcc35e-2b4c-4517-a5c1-741b55f70b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:47.560864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45ecb3f4ffb493187eb8234ed2d86b5', 'request_id': 'req-17bcc35e-2b4c-4517-a5c1-741b55f70b57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:47.640982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:47.641971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:47.642347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:47.642700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:47.643463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:47.645866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:47.828814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 874/1737] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:47 2022] POST /identity/v3/users => generated 302 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:47.831879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.835318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:47.842121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] The token cache is being invalidate because project f45ecb3f4ffb493187eb8234ed2d86b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:47.845188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:47.846298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:47.853701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 864/1738] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:47 2022] DELETE /identity/v3/projects/f45ecb3f4ffb493187eb8234ed2d86b5 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:47.854711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.863268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:47.889243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc35e-2b4c-4517-a5c1-741b55f70b57 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:47.905879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:47.906553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:47.906839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:47.907117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:47.907782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:47.909452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:47.936700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 865/1739] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:47.937748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:47.950925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.000403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd082f-e432-4b21-a623-375e16d056b7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.028466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.029458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.029795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.035320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.035320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.035320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.036976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b53ac-a13e-4632-ad23-903117cd25c0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.043574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.044266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.044546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.044856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.047279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.052610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 866/1740] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:48.054572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.056820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.094114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c48a-d812-4e4a-bfaa-8f854eacbbb7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.107931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.108773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.112997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.113755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] PATH_INFO: `/v3/users/59c6fd155d824c4ba2fd89c23faf368c` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.115852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c6fd155d824c4ba2fd89c23faf368c)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.119345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.155262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.156918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.173169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 875/1741] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:46:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:48.174107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.191819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2ec75-548f-4f75-9ce4-0aec7215ebd3 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.203159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.203944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.204392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.204917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.206099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.221990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.236781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 876/1742] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:48.237985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.252807 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ce87-af46-4963-b883-5577f562c51a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.318256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.318256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.318256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.318727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.322390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.326658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e40af4-3096-47f2-99b5-4de0956a1a01 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.340352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 877/1743] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:48.342667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.343219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.343685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.368249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:48.369699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.403012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:48.453490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 878/1744] 10.222.0.86 () {58 vars in 1015 bytes} [Wed Aug 24 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:48.463053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.477855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3ac3-556d-4538-8648-81614feca983 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.492660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:48.493441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:48.493732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:48.494052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] PATH_INFO: `/v3/projects/272307049f5c4fab9506e54b58fb7c8b/users/8cb58e76aecc47eb96690ffa585ffd2e/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:48.530422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c6fd155d824c4ba2fd89c23faf368c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:48.552943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c6fd155d824c4ba2fd89c23faf368c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:48.555664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c6fd155d824c4ba2fd89c23faf368c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:48.557777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c6fd155d824c4ba2fd89c23faf368c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:48.566539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272307049f5c4fab9506e54b58fb7c8b, user_id=8cb58e76aecc47eb96690ffa585ffd2e, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:48.570836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:48.626187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c6fd155d824c4ba2fd89c23faf368c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:48.634599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 879/1745] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:48 2022] PUT /identity/v3/projects/272307049f5c4fab9506e54b58fb7c8b/users/8cb58e76aecc47eb96690ffa585ffd2e/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:48.647903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.656416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.672383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 867/1746] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:48 2022] DELETE /identity/v3/users/59c6fd155d824c4ba2fd89c23faf368c => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:48.673368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:48.675668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:48.859125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b35e76-d199-4a68-941a-e362b172dcf2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:48.993429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f1c9-3931-4ea0-9eda-e09515b1f53c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:49.000684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:49.002442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.004149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.005924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.011797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:49.012811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.013100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.013387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] PATH_INFO: `/v3/projects/426ed8001b02425fb17de0e27c0d82fc/users/344737b5cb8246eba3f20e9ca73056be/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.014999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:49.034466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426ed8001b02425fb17de0e27c0d82fc, user_id=344737b5cb8246eba3f20e9ca73056be, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:49.038512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:49.077701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:49.085894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ffe08-d164-4ae9-80fa-c119eb76c899 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:49.118497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 868/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:49.121717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3f79-b0da-4357-a302-0f30d366689b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.122418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3f79-b0da-4357-a302-0f30d366689b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.122847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3f79-b0da-4357-a302-0f30d366689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.156974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 880/1748] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:48 2022] PUT /identity/v3/projects/426ed8001b02425fb17de0e27c0d82fc/users/344737b5cb8246eba3f20e9ca73056be/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:49.166501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:49.167958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:49.228074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-974e3f79-b0da-4357-a302-0f30d366689b None None] MFA Rules not processed for user `8cb58e76aecc47eb96690ffa585ffd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:49.233016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-974e3f79-b0da-4357-a302-0f30d366689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:49.359923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088402f-559f-4cdf-8393-3de151ca9d16 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:49.369396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:49.381291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.381722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.383730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] PATH_INFO: `/v3/projects/f690b1917c2c4144b6be052b018eb21f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.385862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f690b1917c2c4144b6be052b018eb21f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:49.392941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:49.415543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 869/1749] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:49.417163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.417450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.417729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.495770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] MFA Rules not processed for user `344737b5cb8246eba3f20e9ca73056be`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:49.497257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:49.810055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f690b1917c2c4144b6be052b018eb21f', 'request_id': 'req-685f0a9b-5990-424c-9269-04bce80846a4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:49.815187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 870/1750] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:49.815187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:49.815187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:49.815187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee1de-d69e-4650-a6fe-9921be209808 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:49.831739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:49.835451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:49.836658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:49.836910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:49.839777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:49.845914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:50.208574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f690b1917c2c4144b6be052b018eb21f', 'request_id': 'req-685f0a9b-5990-424c-9269-04bce80846a4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:50.237108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f690b1917c2c4144b6be052b018eb21f', 'request_id': 'req-685f0a9b-5990-424c-9269-04bce80846a4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:50.242674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 871/1751] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:49 2022] POST /identity/v3/projects => generated 387 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:50.248670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:50.253805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] The token cache is being invalidate because project f690b1917c2c4144b6be052b018eb21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:50.254355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:50.255067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:50.256766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 881/1752] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:49 2022] DELETE /identity/v3/projects/f690b1917c2c4144b6be052b018eb21f => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:50.262058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:50.263633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:50.291685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f0a9b-5990-424c-9269-04bce80846a4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:50.344499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:50.374525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be721575-ea59-4444-9263-e94b56868302 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:50.392037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:50.402247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:50.404282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:50.406722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:50.407519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:50.407885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:50.409284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:50.410229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:50.410411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c2cc9-de1e-4bf8-b80d-c035f0344222 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:50.411849 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:50.413552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:50.420858 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:50.551607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 872/1753] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:50 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:50.551607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:50.551607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:50.551607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:50.572899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 882/1754] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:50 2022] POST /identity/v3/users => generated 300 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:50.576691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:50.582720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:50.601111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:50.602306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:50.610093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb26a-ef00-4e78-ac4e-2b2e700c884a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:50.754155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:50.754776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:50.755066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:50.755778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] PATH_INFO: `/v3/projects/21408f86ec8a4e379a96181f69fe30c5` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:50.760917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 873/1755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:50.761966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:50.770777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=21408f86ec8a4e379a96181f69fe30c5)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:50.778476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:50.778635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:50.802590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989b8-9c13-488f-b2e5-a56c1b69ccaf None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:50.811661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:50.813259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:50.813601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:50.813967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:50.814732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:50.817068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:50.936797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 874/1756] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:50 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:50.938032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:50.991025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243e70c-144d-405f-9d2d-d98628ce27a3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.025138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21408f86ec8a4e379a96181f69fe30c5', 'request_id': 'req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:51.111492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.111492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.111492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.111492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.112173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.112173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9ef0-c7a6-490d-bb92-cc453353f3ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.133780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 875/1757] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:51.135385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.135735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.136076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.174017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21408f86ec8a4e379a96181f69fe30c5', 'request_id': 'req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:51.174886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:51.176255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.187018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21408f86ec8a4e379a96181f69fe30c5', 'request_id': 'req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:51.187819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 876/1758] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:51.190277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.231999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] The token cache is being invalidate because project 21408f86ec8a4e379a96181f69fe30c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:51.232580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:51.232807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ba670-a329-48d7-862b-9b4c96330827 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.233979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:51.237968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 883/1759] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:50 2022] DELETE /identity/v3/projects/21408f86ec8a4e379a96181f69fe30c5 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:51.238155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.239121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.239445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.239723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.240382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.243356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.244211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.247775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.271037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 877/1760] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:51.273100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.276063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ed7bd-c63e-4f66-8e24-dd29cbc76bae admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.279886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.295843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.296721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.307180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.308674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] PATH_INFO: `/v3/projects/729b99a5762e46df9270b870def58ef5/users/e7e46565347240b286afb838d6a95877/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.327962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320ec8a-4cda-4217-9803-98ddfab6e465 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.341990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.342631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.343156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.343437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.344099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:51.344406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.346114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a67d-a789-446a-87d5-0db63483ae79 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.364837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 878/1761] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:51.365565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.365885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.366194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.375670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=729b99a5762e46df9270b870def58ef5, user_id=e7e46565347240b286afb838d6a95877, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.378416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.409763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:51.411262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.426172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 879/1762] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:51.432995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.434783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.460148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ae1a-2f47-452c-b7ce-566b22ec2286 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.475193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.477495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.477846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.478500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] PATH_INFO: `/v3/projects/6e94fbd1a5434fe5be192de07fca3774/users/7feffa09ebd14002a019223d6f73be69/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.522752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 884/1763] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:51 2022] PUT /identity/v3/projects/729b99a5762e46df9270b870def58ef5/users/e7e46565347240b286afb838d6a95877/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:51.522752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.524557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e94fbd1a5434fe5be192de07fca3774, user_id=7feffa09ebd14002a019223d6f73be69, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.532559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00849-3204-4874-b68d-1ca7eae5f2a1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.651546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f5f66-13c1-4623-a323-680c4f857cef admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.654993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.655877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.656281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.656659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.657399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.659480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:51.701678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:51.703005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 880/1764] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:51 2022] PUT /identity/v3/projects/6e94fbd1a5434fe5be192de07fca3774/users/7feffa09ebd14002a019223d6f73be69/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:51.704507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962efb2b-a7a7-4d21-860f-9ff62ef64aa5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.704993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962efb2b-a7a7-4d21-860f-9ff62ef64aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.705654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962efb2b-a7a7-4d21-860f-9ff62ef64aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.733256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-962efb2b-a7a7-4d21-860f-9ff62ef64aa5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:51.734825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-962efb2b-a7a7-4d21-860f-9ff62ef64aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:51.849322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 885/1765] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:51 2022] POST /identity/v3/projects => generated 367 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:51.850571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.878530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 881/1766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:51.879981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34087-1882-4ea8-8d68-8df370467639 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.880292 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34087-1882-4ea8-8d68-8df370467639 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.880570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34087-1882-4ea8-8d68-8df370467639 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.906363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 882/1767] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:46:51 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:51.909470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db34087-1882-4ea8-8d68-8df370467639 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:51.974229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6970e-525b-4de4-bb86-18fe9adf1eea admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:51.987972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:51.988695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:51.989051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:51.989397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:51.990738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:51.997083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.031254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 886/1768] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:52.031254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.045908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a311050-46c3-4b7d-88b5-8de0aa023393 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.052859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.053422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.054327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.054852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.055407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.057816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.086423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db34087-1882-4ea8-8d68-8df370467639 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.097752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.099767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.100197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.101263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.102111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.103902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.122876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 883/1769] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:52.123988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.152554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b7827-059a-481a-842e-691dcb110725 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.154889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.155538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.155872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.156189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.157028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:46:52.157363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.159221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc4188-1edc-4b85-9d5d-be809c2aa5cc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.183157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 884/1770] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:46:52.184934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.185409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.185914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.211455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 887/1771] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:52.211987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:52.212355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.213546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:52.238959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762698d-a240-4d31-9f13-67793cbaad44 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.249963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.250656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.250940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.251216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] PATH_INFO: `/v3/projects/729b99a5762e46df9270b870def58ef5/users/e7e46565347240b286afb838d6a95877/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.258973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729b99a5762e46df9270b870def58ef5, user_id=e7e46565347240b286afb838d6a95877, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.261705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.304781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 888/1772] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:52 2022] PUT /identity/v3/projects/729b99a5762e46df9270b870def58ef5/users/e7e46565347240b286afb838d6a95877/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:52.306557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.312077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 885/1773] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:52.328964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.328964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cea57-003f-46fd-ae9c-da47852c3552 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.410772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.411827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.412424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.413650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.414831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.417959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73bf54-cfb1-4d9e-8362-f22cca5dcc55 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.418356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50957c5c-fbf8-40a3-99f8-ae160603f89c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.424905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.426184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.426701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.427082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] PATH_INFO: `/v3/projects/6e94fbd1a5434fe5be192de07fca3774/users/7feffa09ebd14002a019223d6f73be69/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.429554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e94fbd1a5434fe5be192de07fca3774, user_id=7feffa09ebd14002a019223d6f73be69, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.434774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.458046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 889/1774] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:52 2022] PUT /identity/v3/projects/6e94fbd1a5434fe5be192de07fca3774/users/7feffa09ebd14002a019223d6f73be69/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:52.459211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.595263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 886/1775] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:52.596718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073c5b1-b9f6-4413-a0dc-056c4f50c6de None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.596992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073c5b1-b9f6-4413-a0dc-056c4f50c6de None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.597268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073c5b1-b9f6-4413-a0dc-056c4f50c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.597367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c8fd-2381-4418-a654-815f8934737c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.668145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5073c5b1-b9f6-4413-a0dc-056c4f50c6de None None] MFA Rules not processed for user `e7e46565347240b286afb838d6a95877`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:52.675676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:52.683677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5073c5b1-b9f6-4413-a0dc-056c4f50c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:52.717448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.718612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.719180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.720397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.721706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.729383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.738829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 890/1776] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:52.738829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.738829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:52.818026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 887/1777] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:52.828756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d78d-2a9a-4056-8c03-c5443303da88 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.829085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d78d-2a9a-4056-8c03-c5443303da88 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.829370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d78d-2a9a-4056-8c03-c5443303da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.875847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fe660-360f-4ac2-8673-3d81f1eb636b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:52.914177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eb12d78d-2a9a-4056-8c03-c5443303da88 None None] MFA Rules not processed for user `7feffa09ebd14002a019223d6f73be69`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:52.915038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eb12d78d-2a9a-4056-8c03-c5443303da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:52.916516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:52.917146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:52.917427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:52.917701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:52.928273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:52.930709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:52.962302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 891/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:52.968846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:52.989719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcc7f-9c77-4b63-bb85-f9db63074bf0 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.003168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.005118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.005405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.005687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.008402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.013150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.089587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 888/1779] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:53.089587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4064-807f-48d5-b6f5-3dce61f3bdb9 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.089587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4064-807f-48d5-b6f5-3dce61f3bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.089587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a4064-807f-48d5-b6f5-3dce61f3bdb9 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.089587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 889/1780] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:53.093251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4064-807f-48d5-b6f5-3dce61f3bdb9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.134515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a4064-807f-48d5-b6f5-3dce61f3bdb9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.144762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 892/1781] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:52 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:53.147676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.155182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:53.158596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.159451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.159944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.160399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.161255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.163014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d89692-6d30-4ccb-8fc6-1c9ad3c49631 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.177102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 890/1782] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:53.177289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.177616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.177984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.226856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:53.228096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:53.240004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 891/1783] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:46:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:53.242398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.244811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:53.280077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9608622-48d8-44ab-a0dd-ced83ab972ef admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.287442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.289140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.289140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.289140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.299838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.301306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.316578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88079402-58f4-4b43-8db7-c1c3e5819f60 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.320942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.321093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 893/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:53.321433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.321679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.321780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.322191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.333347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.333519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1cd9-bedc-40bd-87c5-7f37697d4ad4 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.336088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.344358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.344929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.346048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.346581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.348884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.352463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.359274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 892/1785] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:53.360459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.381784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 894/1786] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:53.382777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.386017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b249413-9d68-4ee8-9e7b-9226cd10524c service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.386143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:53.419750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.421005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.421340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.421626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] PATH_INFO: `/v3/projects/b9e41e70c8ef49a0a080efe16230b859/users/dde3732dde1d4fd889a80a3c16c6b769/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.422194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138475e-edeb-41b5-995b-aa6145e6aae0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.445846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.445846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.446340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.453495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.487826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e41e70c8ef49a0a080efe16230b859, user_id=dde3732dde1d4fd889a80a3c16c6b769, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.497969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.500588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cc030-00da-4e52-bffa-851ccfcc4190 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.523244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.548999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 895/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:53.550845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.587685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ff6e-9ee9-4063-9732-f93f59ade487 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.599418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.599656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.599919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.600191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.601694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.603446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.631818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 896/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:53.636299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.640523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 893/1789] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:53 2022] PUT /identity/v3/projects/b9e41e70c8ef49a0a080efe16230b859/users/dde3732dde1d4fd889a80a3c16c6b769/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:53.655082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.655431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.655785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.679934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0610e02-e095-4165-8ebe-9a78bf119d42 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:53.829425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] MFA Rules not processed for user `dde3732dde1d4fd889a80a3c16c6b769`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:53.840011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:53.874504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:53.875750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:53.876501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:53.877048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] PATH_INFO: `/v3/projects/7d1c802a1ab343aa9819df7ef73974c5/users/c1cde2698590405da91dd29b64c7a89f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:53.899383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1c802a1ab343aa9819df7ef73974c5, user_id=c1cde2698590405da91dd29b64c7a89f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:53.904240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:53.946299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:53.983483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 894/1790] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:53.985286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:53.999396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 897/1791] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:53 2022] PUT /identity/v3/projects/7d1c802a1ab343aa9819df7ef73974c5/users/c1cde2698590405da91dd29b64c7a89f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:54.000399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:54.000877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7759f-33b8-43e2-9a0b-761ad7c40ca7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:54.128258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:54.128912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:54.129194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:54.129553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] PATH_INFO: `/v3/users/344737b5cb8246eba3f20e9ca73056be` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:54.130998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344737b5cb8246eba3f20e9ca73056be)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:54.136555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:54.181138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8393-2c78-4ece-b934-09f7ec5b7377 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:54.184915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:54.193134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:54.194808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:54.195297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:54.195814 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] PATH_INFO: `/v3/users/8cb58e76aecc47eb96690ffa585ffd2e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:54.197273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb58e76aecc47eb96690ffa585ffd2e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:54.199430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:54.484296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344737b5cb8246eba3f20e9ca73056be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.495530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344737b5cb8246eba3f20e9ca73056be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.497802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344737b5cb8246eba3f20e9ca73056be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.498924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344737b5cb8246eba3f20e9ca73056be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.615561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344737b5cb8246eba3f20e9ca73056be'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.626734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb58e76aecc47eb96690ffa585ffd2e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.627879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb58e76aecc47eb96690ffa585ffd2e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.649689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb58e76aecc47eb96690ffa585ffd2e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.650741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb58e76aecc47eb96690ffa585ffd2e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.660684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 895/1792] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:53 2022] DELETE /identity/v3/users/344737b5cb8246eba3f20e9ca73056be => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:54.664886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:54.664886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:54.693801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d9825085-8cb8-477b-824f-ae507f67a4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb58e76aecc47eb96690ffa585ffd2e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:54.786153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 898/1793] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:53 2022] DELETE /identity/v3/users/8cb58e76aecc47eb96690ffa585ffd2e => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:54.787444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00283-938a-422e-ab2d-3bfc8cc4c154 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:54.787741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00283-938a-422e-ab2d-3bfc8cc4c154 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:54.788206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00283-938a-422e-ab2d-3bfc8cc4c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:54.802035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf63e7f-cfb3-4933-9ad9-1c3e2fd19587 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:54.882822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-02b00283-938a-422e-ab2d-3bfc8cc4c154 None None] MFA Rules not processed for user `c1cde2698590405da91dd29b64c7a89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:54.884126 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-02b00283-938a-422e-ab2d-3bfc8cc4c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:54.927870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:54.930313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:54.930800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:54.931213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:54.931996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:54.934897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d6ea-5fce-4583-b798-a63d5b327f82 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.026439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 899/1794] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:55.028168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.028972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.029684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.057592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:55.059208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.076925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 896/1795] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:54 2022] POST /identity/v3/projects => generated 365 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:55.076925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.076925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.076925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.077193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 900/1796] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:55.077193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.078738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.116917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16b8bb-7c9d-4f51-87b2-7187a703b5f1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.118232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:55.119492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.243672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.244219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.244499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.245139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.245957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.249246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.261179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 897/1797] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:55.262379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.269767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.283792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f28e-88ec-4b4d-8717-fbf40030a96c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.296187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.297403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.298326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.298626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.301921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.306712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.428644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 901/1798] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:46:55 2022] POST /identity/v3/projects => generated 365 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:55.429513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.433058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.455559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 898/1799] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:55 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:55.456499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.463433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:55.526632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f7ea1-714f-4f18-9b61-03de40d2a86d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.530714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.531423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.531753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.532094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.545604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39834f-7f48-49f8-a60e-9f9de6dfdd5a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.549647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.550317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.550607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.550871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.652008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.653862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.667874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.680378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.684022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 899/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:55.684804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.716553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3f3f5-7d77-4962-8bb1-fd9291a5f3a8 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.718586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 902/1801] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:55.720294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.729024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.729765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.737211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.737211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.737211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.737211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.742678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324582d3-fc59-46d3-9601-c1ffef101014 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.757392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.760688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.760688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.760688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.760688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.761487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.780281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 903/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:55.781220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.792898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2b19-90ec-484e-8577-dce23d95e8aa admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.800535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.801349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.802131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.802421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] PATH_INFO: `/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e/users/215f0e0b78f84427903c186d9be325b8/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.825982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4edb732f7b45dba84ad9fbf71dc55e, user_id=215f0e0b78f84427903c186d9be325b8, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.829651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.858385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 900/1803] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:46:55 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:46:55.860586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.876962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71154a-a2bc-488b-a23c-4cb636edcdfc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:55.883810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:55.884709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:55.885105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:55.885571 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:55.886237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:55.888127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:55.907451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 901/1804] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:55.908115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.932075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 904/1805] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:55 2022] PUT /identity/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e/users/215f0e0b78f84427903c186d9be325b8/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:55.936276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:55.937695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68b8b2-1716-467c-bed2-e75d71df2445 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.021162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:56.092368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f55bd2-d4d2-4532-9792-89d5c43100df admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.101287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.107193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.107390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.107390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.107573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.107667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.107780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.107780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] PATH_INFO: `/v3/projects/58e87f8d2b6b4e8281ae24219cff1827/users/bfc2e61bc94247188ffd90ca6c576814/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.107978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:56.107978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:56.137660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 905/1806] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:46:56.140196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e87f8d2b6b4e8281ae24219cff1827, user_id=bfc2e61bc94247188ffd90ca6c576814, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:56.142290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:56.144108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:56.155656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:56.164667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f5bf-f175-461b-a915-e75ee8ada9e6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.181485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.183202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.183602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.184034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] PATH_INFO: `/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e/users/215f0e0b78f84427903c186d9be325b8/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.186971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4edb732f7b45dba84ad9fbf71dc55e, user_id=215f0e0b78f84427903c186d9be325b8, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:56.194866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e706d-a7a6-4486-b1eb-50af2ae775b2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:56.222773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 906/1807] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:56 2022] PUT /identity/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e/users/215f0e0b78f84427903c186d9be325b8/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:46:56.235264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.236522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.237192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.277593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 902/1808] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:55 2022] PUT /identity/v3/projects/58e87f8d2b6b4e8281ae24219cff1827/users/bfc2e61bc94247188ffd90ca6c576814/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:56.279272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:56.325092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] MFA Rules not processed for user `215f0e0b78f84427903c186d9be325b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:56.325092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:56.457414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dda7-e409-436b-b9d0-129fadc06a37 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.467906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.470023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.470308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.472713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.473550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:56.479643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 907/1809] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:56.479835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:56.489432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:56.493039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:56.543142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 903/1810] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:46:56.543142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:56.565515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c043c0d-6ce8-4a84-b292-d6c3174a8cfb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.597123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.599646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.602128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.602436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] PATH_INFO: `/v3/projects/58e87f8d2b6b4e8281ae24219cff1827/users/bfc2e61bc94247188ffd90ca6c576814/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.619576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e87f8d2b6b4e8281ae24219cff1827, user_id=bfc2e61bc94247188ffd90ca6c576814, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:56.629795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8d4a-cb87-4790-b6b2-665f1f31445b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:56.657986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 904/1811] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:46:56 2022] PUT /identity/v3/projects/58e87f8d2b6b4e8281ae24219cff1827/users/bfc2e61bc94247188ffd90ca6c576814/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:56.677096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.677415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.677659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:56.704780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c222bfa-cf2a-43d6-ba06-a31db86f9dec None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:56.789863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] MFA Rules not processed for user `bfc2e61bc94247188ffd90ca6c576814`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:56.794041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:56.887736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:56.889889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:56.889889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:56.889889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.039154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 905/1812] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:46:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:46:57.070401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.075419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:57.088522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 908/1813] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:57.159979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:57.161464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:57.300595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:57.300595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:57.306025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0aba83-dd69-4f48-922f-1053074d37e7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:57.322210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:57.322867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:57.325346 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:57.325646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] PATH_INFO: `/v3/projects/272307049f5c4fab9506e54b58fb7c8b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.330919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=272307049f5c4fab9506e54b58fb7c8b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.335260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:57.335260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888839-5ca0-4976-9655-fc57b754c8d5 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:57.335638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:57.339865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:57.340901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:57.341482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:57.342480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.375784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.378851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:57.394549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 909/1814] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:57.434927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:57.536104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272307049f5c4fab9506e54b58fb7c8b', 'request_id': 'req-9262f0c7-e2b6-4db3-874e-86b279d6f26c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:57.546010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272307049f5c4fab9506e54b58fb7c8b', 'request_id': 'req-9262f0c7-e2b6-4db3-874e-86b279d6f26c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:57.573600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272307049f5c4fab9506e54b58fb7c8b', 'request_id': 'req-9262f0c7-e2b6-4db3-874e-86b279d6f26c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:57.651046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:57.664612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab6b9-f78b-41b9-a7e7-0d4611d9b0a3 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:57.700952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] The token cache is being invalidate because project 272307049f5c4fab9506e54b58fb7c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:57.701363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:57.711747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:57.721002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 906/1815] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:57 2022] DELETE /identity/v3/projects/272307049f5c4fab9506e54b58fb7c8b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:57.725418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:57.727705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:57.758570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:57.760004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:57.760468 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:57.763388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.765869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:57.876189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.877985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:57.899128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262f0c7-e2b6-4db3-874e-86b279d6f26c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:57.909786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:57.916141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 910/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:57.917398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:57.918134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:57.919041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:57.920119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:57.920258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] PATH_INFO: `/v3/users/e7e46565347240b286afb838d6a95877` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.924598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e46565347240b286afb838d6a95877)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.926214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:57.959647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02ee1a-07ea-43f3-b998-f0f1f2135484 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:57.978251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:57.979254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:57.979756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:57.980293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] PATH_INFO: `/v3/projects/426ed8001b02425fb17de0e27c0d82fc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:57.982195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=426ed8001b02425fb17de0e27c0d82fc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:57.987537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:58.198308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:58.250134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e46565347240b286afb838d6a95877'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.259428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e46565347240b286afb838d6a95877'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.260419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e46565347240b286afb838d6a95877'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.261062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e46565347240b286afb838d6a95877'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.276375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426ed8001b02425fb17de0e27c0d82fc', 'request_id': 'req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.347080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e46565347240b286afb838d6a95877'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.388686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 907/1817] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:57 2022] DELETE /identity/v3/users/e7e46565347240b286afb838d6a95877 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:46:58.392999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:58.395847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:58.433866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426ed8001b02425fb17de0e27c0d82fc', 'request_id': 'req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.445482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426ed8001b02425fb17de0e27c0d82fc', 'request_id': 'req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.494259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] The token cache is being invalidate because project 426ed8001b02425fb17de0e27c0d82fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:46:58.496190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.499116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:58.504884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 911/1818] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:46:57 2022] DELETE /identity/v3/projects/426ed8001b02425fb17de0e27c0d82fc => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:46:58.522018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:58.525806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:58.587256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61aa5d-fd76-4ad8-bcab-c98e6c1bfbd6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:58.595144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:58.596202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:58.596687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:58.597170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:58.600857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:58.689378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb9a02-ffe9-4c4a-a1d8-28e30a1b8d0f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:58.748852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:58.750526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:58.780959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 908/1819] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:58.849677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:58.849677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:58.849677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:58.849677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] PATH_INFO: `/v3/users/7feffa09ebd14002a019223d6f73be69` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:58.850484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feffa09ebd14002a019223d6f73be69)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:58.850484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:58.935729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:59.239677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feffa09ebd14002a019223d6f73be69'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:59.240361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feffa09ebd14002a019223d6f73be69'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:59.254822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feffa09ebd14002a019223d6f73be69'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:59.255632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feffa09ebd14002a019223d6f73be69'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:59.274505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feffa09ebd14002a019223d6f73be69'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:46:59.385979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 912/1820] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:46:58 2022] DELETE /identity/v3/users/7feffa09ebd14002a019223d6f73be69 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:46:59.529200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:00.033064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.050034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.065954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20d963-0be7-4f86-bf2d-da8929584bd6 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.131587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.132828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.133111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.133386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] PATH_INFO: `/v3/projects/729b99a5762e46df9270b870def58ef5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.134969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729b99a5762e46df9270b870def58ef5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.136869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.261627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729b99a5762e46df9270b870def58ef5', 'request_id': 'req-804f64b2-70b5-41c5-a7db-27d100892553'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.262710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729b99a5762e46df9270b870def58ef5', 'request_id': 'req-804f64b2-70b5-41c5-a7db-27d100892553'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.269272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729b99a5762e46df9270b870def58ef5', 'request_id': 'req-804f64b2-70b5-41c5-a7db-27d100892553'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.356312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] The token cache is being invalidate because project 729b99a5762e46df9270b870def58ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:00.356617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.357579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-804f64b2-70b5-41c5-a7db-27d100892553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.358573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.360090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.364126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 909/1821] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:00 2022] DELETE /identity/v3/projects/729b99a5762e46df9270b870def58ef5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:00.368342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea8fe-363c-4551-95cb-39a4644a6052 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.368633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea8fe-363c-4551-95cb-39a4644a6052 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.368913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea8fe-363c-4551-95cb-39a4644a6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.374946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63869eb-fec8-4fdb-ab4a-f5af1bd5efef admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.398991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e8cea8fe-363c-4551-95cb-39a4644a6052 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:00.400281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e8cea8fe-363c-4551-95cb-39a4644a6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.437995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.438636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.438913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.439191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] PATH_INFO: `/v3/projects/6e94fbd1a5434fe5be192de07fca3774` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.440433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e94fbd1a5434fe5be192de07fca3774)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.442598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.474876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 910/1822] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:00.483015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.483305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.483582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.505044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:00.506320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.515625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 911/1823] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:00.519637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.529840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374fba-9775-4f49-9739-cd1331f8af4f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.534781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.535442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.535728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.536002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.536657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:00.536965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.538873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.552935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 912/1824] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:00.557435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.558948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e94fbd1a5434fe5be192de07fca3774', 'request_id': 'req-2b72914e-7210-4f1c-8335-5c6545c8e6ed'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.568491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d971bc-4223-413f-844e-356ec1a224a2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.630532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.631614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.632749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.634625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.634722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.636319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:00.639245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.677130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e94fbd1a5434fe5be192de07fca3774', 'request_id': 'req-2b72914e-7210-4f1c-8335-5c6545c8e6ed'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.684631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e94fbd1a5434fe5be192de07fca3774', 'request_id': 'req-2b72914e-7210-4f1c-8335-5c6545c8e6ed'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.696773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] The token cache is being invalidate because project 6e94fbd1a5434fe5be192de07fca3774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:00.697070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.697739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2b72914e-7210-4f1c-8335-5c6545c8e6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:00.700014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 913/1825] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:00 2022] DELETE /identity/v3/projects/6e94fbd1a5434fe5be192de07fca3774 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:00.704687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086df08-e838-4652-80ad-90b013d0e2ca None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.705311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086df08-e838-4652-80ad-90b013d0e2ca None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.705669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086df08-e838-4652-80ad-90b013d0e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.725894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c086df08-e838-4652-80ad-90b013d0e2ca None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:00.727216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c086df08-e838-4652-80ad-90b013d0e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.735177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 914/1826] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:00.743500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.743787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.744065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.759807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 913/1827] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/projects => generated 359 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:00.764496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:00.765717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.766765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.768570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:00.826865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 915/1828] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:00.831164 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.839479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ca431-360f-484f-bdd8-ec0565d10d80 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.840107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d799f-1335-4c13-88d6-0fc1dc445547 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.844706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.844918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.845335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.845585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.845683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.845865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.845971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.846182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.846535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.847132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:00.847408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.848534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.849219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.861052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 916/1829] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:00.867242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.879182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ccbda-cf9b-4023-9976-3128b11aba97 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.884593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.885193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.885475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.885751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.886405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.888362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.917624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 914/1830] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/users => generated 280 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:00.921592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.931971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f32665-bd84-4e30-8801-f787c5483125 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.937998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.938716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.941359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.941359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.941359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.941604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.952237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 915/1831] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:00.956023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.965247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71fa90-bcb1-40b8-9834-4b1c93f16d5e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:00.969804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:00.970398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:00.970679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:00.970954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:00.971595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:00.973293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:00.988747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 916/1832] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:00.988747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.989381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 917/1833] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:00.990506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:00.997693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff2af-d424-4ffd-85f1-f917fd768f63 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.054978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524feb-7d06-408a-8ecd-ca75e451d1a3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.056948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.056948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.056948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.060480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.067015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.067015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.067015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] PATH_INFO: `/v3/projects/3c59a6bfdc514c0db9dbadb0120cab23/users/8045c70988a94de5ad165fbdc2ef2d4a/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.067493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.067493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.067493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.077917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c59a6bfdc514c0db9dbadb0120cab23, user_id=8045c70988a94de5ad165fbdc2ef2d4a, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.082091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18adee-2c6b-470a-be19-03aa2e731a4f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.159707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 917/1834] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:00 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:01.166801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.178891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c752aa-8c9e-40ed-b99c-d8cb448e7c27 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.186132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.187322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.187569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.189732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.189732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.191993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.193241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 918/1835] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:00 2022] PUT /identity/v3/projects/3c59a6bfdc514c0db9dbadb0120cab23/users/8045c70988a94de5ad165fbdc2ef2d4a/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:01.203322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.203611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.204046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.233232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 918/1836] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:01.234996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.238859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] MFA Rules not processed for user `8045c70988a94de5ad165fbdc2ef2d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:01.240205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:01.256645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00592-1959-4527-beb2-12a80780c9ee admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.319042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 919/1837] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:01.320369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:01.326069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.326692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.326974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.327246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.327894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.329491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d39ac-f571-44f6-8867-ca7b93760af5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.340526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 919/1838] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:01.349967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.361401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30512-3404-4b07-ab2b-c6040acc2be5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.376971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.377982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.378987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.380454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] PATH_INFO: `/v3/projects/914c0b55239847baa0030282794989d3/users/0b13e0580bbd48ad809543b6dd6bd382/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.398227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914c0b55239847baa0030282794989d3, user_id=0b13e0580bbd48ad809543b6dd6bd382, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.401200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.489389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 920/1839] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:01 2022] PUT /identity/v3/projects/914c0b55239847baa0030282794989d3/users/0b13e0580bbd48ad809543b6dd6bd382/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:01.495549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.495913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.496262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.516847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:01.518111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:01.586040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 920/1840] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:01.597007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.598826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:01.660000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d6e4-640a-4de6-9215-49081d60d905 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.664280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.665004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.665283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.665554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.676329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.678440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.694128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 921/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:01.773631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.775978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:01.874495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dbafd-57df-47c9-9573-f643e073b384 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.879786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.880887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.881297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:01.881731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:01.953757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:01.955235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e09401-db3e-4145-b11b-5c74ac6ba4ad service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:01.964988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 921/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:01.981159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:01.992218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac88ac6-bb02-4901-99f8-12772fb2cf42 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:01.998347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:01.999238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:01.999723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:02.000205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] PATH_INFO: `/v3/users/8045c70988a94de5ad165fbdc2ef2d4a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:02.001606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8045c70988a94de5ad165fbdc2ef2d4a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:02.003780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:02.233909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8045c70988a94de5ad165fbdc2ef2d4a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:02.235773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8045c70988a94de5ad165fbdc2ef2d4a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:02.246082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8045c70988a94de5ad165fbdc2ef2d4a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:02.247151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8045c70988a94de5ad165fbdc2ef2d4a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:02.268839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8045c70988a94de5ad165fbdc2ef2d4a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:02.370237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 922/1843] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:01 2022] DELETE /identity/v3/users/8045c70988a94de5ad165fbdc2ef2d4a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:02.401393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:02.401393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:02.401393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:02.418209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:02.419363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:02.497973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 922/1844] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:02.498079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:02.498079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:02.567202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0dbbc-3bed-468c-9585-c4beb35485fc admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:02.571688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:02.572291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:02.572567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:02.572836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:02.582956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:02.584555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5305f-92a6-4220-97ea-c0f811c47f8b service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:02.595672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 923/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:03.086977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.090612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.114850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31212fc2-2e2b-413a-9dc8-8d80068b10b8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.130112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.130112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.130112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.130112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] PATH_INFO: `/v3/projects/3c59a6bfdc514c0db9dbadb0120cab23` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.130474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c59a6bfdc514c0db9dbadb0120cab23)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.131406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.205314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.205693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.206089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.252829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] MFA Rules not processed for user `0b13e0580bbd48ad809543b6dd6bd382`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:03.254596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.263319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c59a6bfdc514c0db9dbadb0120cab23', 'request_id': 'req-513ca26e-486d-470b-88d1-01218932065b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:03.268893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c59a6bfdc514c0db9dbadb0120cab23', 'request_id': 'req-513ca26e-486d-470b-88d1-01218932065b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:03.277692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c59a6bfdc514c0db9dbadb0120cab23', 'request_id': 'req-513ca26e-486d-470b-88d1-01218932065b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:03.338117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 924/1846] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:03.339063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.340578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.364791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] The token cache is being invalidate because project 3c59a6bfdc514c0db9dbadb0120cab23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:03.364791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:03.364791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-513ca26e-486d-470b-88d1-01218932065b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:03.364791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 923/1847] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:03 2022] DELETE /identity/v3/projects/3c59a6bfdc514c0db9dbadb0120cab23 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:03.380963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97a8-2731-4009-83af-a2f8cdf1687c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.381356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97a8-2731-4009-83af-a2f8cdf1687c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.381884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc97a8-2731-4009-83af-a2f8cdf1687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.403809 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-46bc97a8-2731-4009-83af-a2f8cdf1687c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:03.405168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-46bc97a8-2731-4009-83af-a2f8cdf1687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.413802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 924/1848] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:03.416909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038722d-6936-4dbc-bf49-61e9fbf4a81d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.422033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.422657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.422778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.422969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.423083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.423236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.423333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.423876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.425792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.443376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:03.445307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.453616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 925/1849] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:03.466216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.467679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c004d-8150-4cad-bd73-7b5dc4767d14 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.473264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.473864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.474169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.475069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.475194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:03.475631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.477185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.497431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 926/1850] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:03.497972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.508757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df570363-6012-4400-9ca6-0f19d8002682 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.513423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.514044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.514326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.514783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.515349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.518779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.550854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 925/1851] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:03.554443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.556915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:03.604377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:03.655162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 927/1852] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:03.660430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.676107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497ad3e-af62-46b2-9773-c53f04de12f1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.753321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183354e-aff4-46f1-864e-4d91191cae67 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.756509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.760286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.760286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.760286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.760506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.760601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.760679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.760679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.760679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.760679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.760920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.762197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.846065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 926/1853] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/users => generated 309 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:03.848141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 928/1854] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:03 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:03.848775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.849625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.860856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc579c8d-2716-48b7-82ef-1318c729b1cc admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.862629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4961-87b4-4238-8e6c-89ad693754a1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.865762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.869350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.869350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.869350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.869350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.875116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.875470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.875667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.875667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.875667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.875667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.875667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.880836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 927/1855] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:03.884674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.889667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 929/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:03.891286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.894569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523e7d-882d-4df0-b1e1-ccdc9c707b4c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.899226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.899953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.903628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.903628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.903628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.903868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c7c4-d5cb-41ca-ac1a-facea5c81fc3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.903965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.908405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.909136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.909493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.909892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] PATH_INFO: `/v3/projects/53f590bba2334072847fc37034a01587/users/c52e58099e514fde99e3fd61886de14d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.914055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 928/1857] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:03.918899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:03.927261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f590bba2334072847fc37034a01587, user_id=c52e58099e514fde99e3fd61886de14d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.930971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:03.933699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76131c72-2d2e-488a-9432-14b8663b2be0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:03.938797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:03.939531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:03.939885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:03.940253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] PATH_INFO: `/v3/projects/eb2a581b5585424f8c1a8cb618ad873e/users/95053819fe5a4e81857608cdc5b39c1f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:03.955497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2a581b5585424f8c1a8cb618ad873e, user_id=95053819fe5a4e81857608cdc5b39c1f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:03.958299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41508ad-bb48-464b-a2fe-132a68432315 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.037845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 930/1858] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:03 2022] PUT /identity/v3/projects/53f590bba2334072847fc37034a01587/users/c52e58099e514fde99e3fd61886de14d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:04.044483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.067333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 929/1859] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:03 2022] PUT /identity/v3/projects/eb2a581b5585424f8c1a8cb618ad873e/users/95053819fe5a4e81857608cdc5b39c1f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:04.078242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321205b4-7315-4829-a38f-c8262b84213a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.078242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321205b4-7315-4829-a38f-c8262b84213a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.078242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321205b4-7315-4829-a38f-c8262b84213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.107632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-321205b4-7315-4829-a38f-c8262b84213a None None] MFA Rules not processed for user `95053819fe5a4e81857608cdc5b39c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:04.109122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-321205b4-7315-4829-a38f-c8262b84213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:04.113280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e518d-f6a6-464a-a9b8-5826243297af admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.161179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:04.188476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.194593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.194593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.194593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.194593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.194593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.209115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 930/1860] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:04.216563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 931/1861] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:04.217894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321205b4-7315-4829-a38f-c8262b84213a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.219679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.229915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321205b4-7315-4829-a38f-c8262b84213a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.238354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.239207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.239545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.239822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.243306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79386eb8-3c0a-43b8-9b98-91d9c26e7cdb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.246167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.246167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.250622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.251765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.252596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.253145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] PATH_INFO: `/v3/projects/53f590bba2334072847fc37034a01587/users/c52e58099e514fde99e3fd61886de14d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.255410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f590bba2334072847fc37034a01587, user_id=c52e58099e514fde99e3fd61886de14d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.259059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.272533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 932/1862] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:04 2022] PUT /identity/v3/projects/53f590bba2334072847fc37034a01587/users/c52e58099e514fde99e3fd61886de14d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:04.375434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 931/1863] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:04 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:04.383835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.483291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a80b5-2f20-43bd-8fe5-dd4ff2554a7d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.547995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.548638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.548919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.549191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.549815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.551755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.655725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 933/1864] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:04 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:04.660162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.670860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41bc6f-e215-47d9-b6fe-82262ca11f2f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.675512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.676349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.676817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.677294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.677972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.679842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.696280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 932/1865] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:04.700614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.711463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df8b1-4bc9-43ac-b9ca-400e9888d74c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.716252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.716851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.717231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.717549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.718273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.720057 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c88d19-d1aa-4253-a1b9-0132e2d680c3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.730851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 934/1866] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:04.734921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:04.745350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe84d3e-c862-4a42-aea1-b5eadcfc7a43 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:04.750628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:04.751779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.751943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.752222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] PATH_INFO: `/v3/projects/374d4d5053e24b6dbdfcadf2fd1241a5/users/ec5e6056f8b84e4cb53079c6e0cac483/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.770683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374d4d5053e24b6dbdfcadf2fd1241a5, user_id=ec5e6056f8b84e4cb53079c6e0cac483, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:04.773949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:04.849599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 933/1867] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:04 2022] PUT /identity/v3/projects/374d4d5053e24b6dbdfcadf2fd1241a5/users/ec5e6056f8b84e4cb53079c6e0cac483/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:04.865767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:04.866156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:04.866959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:04.921675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] MFA Rules not processed for user `ec5e6056f8b84e4cb53079c6e0cac483`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:04.923610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:05.021710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 935/1868] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:05.030175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.111565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f2b-fccb-45d4-803b-fb4ef6013450 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.118009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822012-f865-47e8-a67e-490208660961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.118614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822012-f865-47e8-a67e-490208660961 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.118923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822012-f865-47e8-a67e-490208660961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.119194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822012-f865-47e8-a67e-490208660961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.119842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45822012-f865-47e8-a67e-490208660961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.121852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45822012-f865-47e8-a67e-490208660961 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.296857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 934/1869] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:05 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:05.301016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.312383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99365c66-5d9a-4576-bca8-0ea7709e7af4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.373823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.374567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.374930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.375272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.375965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.377980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.499811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 936/1870] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:05 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:05.501834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822012-f865-47e8-a67e-490208660961 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.512862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822012-f865-47e8-a67e-490208660961 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.519499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.520181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.520464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.520737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.521448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.523648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.536488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 935/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:05.541370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.552856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5c8b-32d7-4e35-b424-5b277f4e621b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.558527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.559199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.559474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.559745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] PATH_INFO: `/v3/projects/1eb1b87cda104e28aadba778a22381e4/users/202f298d0c76483b957a1682ae771dbd/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.576445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb1b87cda104e28aadba778a22381e4, user_id=202f298d0c76483b957a1682ae771dbd, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.579221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.666952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:05.681608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 937/1872] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:05 2022] PUT /identity/v3/projects/1eb1b87cda104e28aadba778a22381e4/users/202f298d0c76483b957a1682ae771dbd/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:05.688464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.703517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475fff5-4407-4d94-913c-75b4cb73bd89 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.770759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.771572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.772144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.772526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.773294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.774951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24874d3-cc0f-490f-993a-40ffcb10aa64 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.785551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 936/1873] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:05.790210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.801757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3058-27e8-4925-8e3d-43419c369b79 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:05.807096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:05.807826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.808102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.808371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] PATH_INFO: `/v3/projects/1eb1b87cda104e28aadba778a22381e4/users/202f298d0c76483b957a1682ae771dbd/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.810331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb1b87cda104e28aadba778a22381e4, user_id=202f298d0c76483b957a1682ae771dbd, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:05.810459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.810678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.810954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.813031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98620085-b4c2-4364-9dfc-e04207478f4e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:05.828871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 938/1874] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:05 2022] PUT /identity/v3/projects/1eb1b87cda104e28aadba778a22381e4/users/202f298d0c76483b957a1682ae771dbd/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:05.835717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d208-2d63-4cf6-9d4a-0e82e5578770 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:05.841995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d208-2d63-4cf6-9d4a-0e82e5578770 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:05.841995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d208-2d63-4cf6-9d4a-0e82e5578770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:05.845251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] MFA Rules not processed for user `c52e58099e514fde99e3fd61886de14d`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:05.846488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:05.868326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-51f8d208-2d63-4cf6-9d4a-0e82e5578770 None None] MFA Rules not processed for user `202f298d0c76483b957a1682ae771dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:05.870326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-51f8d208-2d63-4cf6-9d4a-0e82e5578770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:05.923088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 937/1875] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:05.947921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 939/1876] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:05.960048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:05.962155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:06.024839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e73c86-3444-4441-b58d-1351b70ca652 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:06.028718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:06.029467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:06.029599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:06.030074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:06.095872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:06.097358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01831-685e-4c06-b7a3-0ee2b8bb4152 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:06.107613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 938/1877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:06.733534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:06.734050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:06.734127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:06.735508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 940/1878] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:47:06.752183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:06.752918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:06.753197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:06.777518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:06.779183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:06.872586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 939/1879] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:47:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:06.891799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:06.904035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:06.915080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c16c-fe7c-406a-b8c4-94b12d73f05f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:06.926198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:06.928767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:06.929989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:06.930264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:06.930772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:06.942906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:06.945446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced1a6-9db3-4b78-bbd8-0a421198ce2d service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:06.965060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 941/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:07.188969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:07.416935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:07.418479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:07.483198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c31bf-5d83-421d-8c4f-781e2315a547 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:07.490039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:07.490665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:07.490966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:07.491239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] PATH_INFO: `/v3/users/dde3732dde1d4fd889a80a3c16c6b769` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:07.493288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde3732dde1d4fd889a80a3c16c6b769)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:07.495357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:07.581962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7dfb-0bc5-43c8-8f8f-7e0b1dc05e21 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:07.582933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7dfb-0bc5-43c8-8f8f-7e0b1dc05e21 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:07.583498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af7dfb-0bc5-43c8-8f8f-7e0b1dc05e21 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:07.587026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 942/1881] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:47:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:47:07.597358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:07.598123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:07.598578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:07.622970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] MFA Rules not processed for user `86cdd101e8d840be856ace9511917a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:07.623303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:07.633825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 943/1882] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:47:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:07.651419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:07.661957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e32dd-4549-41de-88e7-dd631c3b6395 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:07.668445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:07.669122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:07.674995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:07.675290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:07.685152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:07.686801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:07.714059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 944/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:08.708874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde3732dde1d4fd889a80a3c16c6b769'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:08.709565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde3732dde1d4fd889a80a3c16c6b769'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:08.717125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde3732dde1d4fd889a80a3c16c6b769'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:08.717769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde3732dde1d4fd889a80a3c16c6b769'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:08.748262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-d0228060-e8c8-45b8-bfad-e812102d45ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde3732dde1d4fd889a80a3c16c6b769'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:08.749897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:08.765093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da64e-07aa-46e6-8513-834b3fa3bf16 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:08.771413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:08.771748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:08.772150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:08.774563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] PATH_INFO: `/v3/users/0b13e0580bbd48ad809543b6dd6bd382` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:08.775887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b13e0580bbd48ad809543b6dd6bd382)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:08.778042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:08.849428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 940/1884] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:07 2022] DELETE /identity/v3/users/dde3732dde1d4fd889a80a3c16c6b769 => generated 0 bytes in 1433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:08.853872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:08.854195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:08.854475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:08.873107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:08.874352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:08.933166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 941/1885] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:08.944443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:08.946319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:09.002083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220826e-1725-4331-8f25-0339b3d1e763 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:09.005671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:09.006303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:09.006581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:09.006851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:09.016854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:09.018448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:09.022978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b13e0580bbd48ad809543b6dd6bd382'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.027966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 942/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:09.030838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b13e0580bbd48ad809543b6dd6bd382'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.031845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b13e0580bbd48ad809543b6dd6bd382'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.034972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b13e0580bbd48ad809543b6dd6bd382'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.160488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b13e0580bbd48ad809543b6dd6bd382'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.178723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 945/1887] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:08 2022] DELETE /identity/v3/users/0b13e0580bbd48ad809543b6dd6bd382 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:09.595493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:09.597341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:09.621993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d9e3c-5406-45df-b894-baa260fc6c43 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:09.643109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:09.651122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:09.684114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:09.741132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb3af-9242-46ca-a8e8-6698abc39940 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:09.746296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:09.747977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:09.747977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:09.747977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:09.749706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:09.760005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:09.762081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:09.762556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:09.763020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] PATH_INFO: `/v3/projects/b9e41e70c8ef49a0a080efe16230b859` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:09.765651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e41e70c8ef49a0a080efe16230b859)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:09.767778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:09.840844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:09.845673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:09.874992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:09.875859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 946/1888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:09.879886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:09.882848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:09.884852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e41e70c8ef49a0a080efe16230b859', 'request_id': 'req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:09.900759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99546156-2564-4f37-8389-76c248a54036 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:09.972240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:09.972889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:09.973314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:09.973613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] PATH_INFO: `/v3/projects/914c0b55239847baa0030282794989d3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:09.974829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914c0b55239847baa0030282794989d3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:09.976889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:10.021540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e41e70c8ef49a0a080efe16230b859', 'request_id': 'req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.029546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e41e70c8ef49a0a080efe16230b859', 'request_id': 'req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.040014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] The token cache is being invalidate because project b9e41e70c8ef49a0a080efe16230b859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:10.040305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.041093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.042650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 943/1889] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:09 2022] DELETE /identity/v3/projects/b9e41e70c8ef49a0a080efe16230b859 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:10.046451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:10.047753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:10.060671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0ea7-a110-4148-a03e-99f4ecb35b43 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:10.065491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:10.066173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:10.066458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:10.066735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] PATH_INFO: `/v3/users/215f0e0b78f84427903c186d9be325b8` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:10.067880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] RBAC: Authorizing `identity:delete_user(user_id=215f0e0b78f84427903c186d9be325b8)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:10.069860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:10.100121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914c0b55239847baa0030282794989d3', 'request_id': 'req-1a262196-a2af-4ece-9806-54ff38fe26d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.106677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914c0b55239847baa0030282794989d3', 'request_id': 'req-1a262196-a2af-4ece-9806-54ff38fe26d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.114742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914c0b55239847baa0030282794989d3', 'request_id': 'req-1a262196-a2af-4ece-9806-54ff38fe26d4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.208312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] The token cache is being invalidate because project 914c0b55239847baa0030282794989d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:10.208814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.210306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.213340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 947/1890] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:09 2022] DELETE /identity/v3/projects/914c0b55239847baa0030282794989d3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:10.217331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:10.218802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:10.267728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215f0e0b78f84427903c186d9be325b8'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.268390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215f0e0b78f84427903c186d9be325b8'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.275238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215f0e0b78f84427903c186d9be325b8'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.275918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215f0e0b78f84427903c186d9be325b8'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.287372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a262196-a2af-4ece-9806-54ff38fe26d4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:10.289454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-74d7d218-65b1-4339-be4a-d94e1109702b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215f0e0b78f84427903c186d9be325b8'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.292904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:10.293541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:10.293822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:10.294158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] PATH_INFO: `/v3/users/c52e58099e514fde99e3fd61886de14d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:10.295330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52e58099e514fde99e3fd61886de14d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:10.297275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:10.432947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 944/1891] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:10 2022] DELETE /identity/v3/users/215f0e0b78f84427903c186d9be325b8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:10.546204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52e58099e514fde99e3fd61886de14d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.553422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52e58099e514fde99e3fd61886de14d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.556111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52e58099e514fde99e3fd61886de14d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.556111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52e58099e514fde99e3fd61886de14d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.667051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52e58099e514fde99e3fd61886de14d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:10.703912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 948/1892] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:10 2022] DELETE /identity/v3/users/c52e58099e514fde99e3fd61886de14d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:11.026892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9426-7e46-4155-9370-202cf7bf7d50 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.027953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9426-7e46-4155-9370-202cf7bf7d50 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.028420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9426-7e46-4155-9370-202cf7bf7d50 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.032146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 945/1893] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:47:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:47:11.050287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.056282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.056830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.057241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.068087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.129803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:11.131202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.166054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7ad2-d6f3-409e-bb73-c081654804b2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.171964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.172813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.173098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.173364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] PATH_INFO: `/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.175251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4edb732f7b45dba84ad9fbf71dc55e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.177324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.216149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 946/1894] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:11.222460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.224394 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.240106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfb774-b645-44a6-a602-ecdd2bb7cd50 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.247627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.248731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.249308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.249790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] PATH_INFO: `/v3/projects/53f590bba2334072847fc37034a01587` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.251284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f590bba2334072847fc37034a01587)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.253412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.354160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4edb732f7b45dba84ad9fbf71dc55e', 'request_id': 'req-e8e37583-f294-4662-82be-d274f4711bb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.360863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4edb732f7b45dba84ad9fbf71dc55e', 'request_id': 'req-e8e37583-f294-4662-82be-d274f4711bb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.366222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f590bba2334072847fc37034a01587', 'request_id': 'req-a43e1a93-c652-4521-85bf-3121f9d39920'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.369263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4edb732f7b45dba84ad9fbf71dc55e', 'request_id': 'req-e8e37583-f294-4662-82be-d274f4711bb0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.494276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f590bba2334072847fc37034a01587', 'request_id': 'req-a43e1a93-c652-4521-85bf-3121f9d39920'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.501466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f590bba2334072847fc37034a01587', 'request_id': 'req-a43e1a93-c652-4521-85bf-3121f9d39920'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.514376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] The token cache is being invalidate because project 53f590bba2334072847fc37034a01587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:11.514683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.515337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.516945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 947/1895] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:11 2022] DELETE /identity/v3/projects/53f590bba2334072847fc37034a01587 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:11.517712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.529503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.599702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1a93-c652-4521-85bf-3121f9d39920 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.606260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.606886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.607169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.607445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.609296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.624781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.624781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98e8ea-4363-4b1f-aa9c-e079b0305919 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.636092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 948/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:11.637285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e777-ec5e-4e2e-8e78-fbaab4521039 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.637629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e777-ec5e-4e2e-8e78-fbaab4521039 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.638171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e777-ec5e-4e2e-8e78-fbaab4521039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.663549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-02e8e777-ec5e-4e2e-8e78-fbaab4521039 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:11.665688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-02e8e777-ec5e-4e2e-8e78-fbaab4521039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.682402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] The token cache is being invalidate because project ef4edb732f7b45dba84ad9fbf71dc55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:11.682695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.684244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e8e37583-f294-4662-82be-d274f4711bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:11.686238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 949/1897] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:11 2022] DELETE /identity/v3/projects/ef4edb732f7b45dba84ad9fbf71dc55e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:11.696719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3d5-a8fd-4b20-8d93-b43a27d0e5e8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.697115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3d5-a8fd-4b20-8d93-b43a27d0e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.697738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a3d5-a8fd-4b20-8d93-b43a27d0e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.717663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-39a8a3d5-a8fd-4b20-8d93-b43a27d0e5e8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:11.718961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39a8a3d5-a8fd-4b20-8d93-b43a27d0e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.739882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 949/1898] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:11.749113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.749421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.749697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.770271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:11.771774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.780249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 950/1899] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:11.784726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.790713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 950/1900] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:11.798107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.798396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.798673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.798804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36edb-52e9-4d1c-a146-93bacb1d1fac None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.803753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.805695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.805695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.805695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.806207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:11.806513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.808131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.818931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:11.823105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 951/1901] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:11.823270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:11.824681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.828693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 951/1902] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:11.832739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.835535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0f6b1-e0eb-4d99-b501-84feddf01357 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.841145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.841757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.842079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.842321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a7b7-88ae-4eba-8522-73ea67d04cc5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.842561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.843199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.845236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.846969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.847624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.847830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.848143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.848738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:11.849039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.850693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.863317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 952/1903] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:11.868697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:11.878568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdf97b-e8ab-4039-ac30-d3c9fb180fe2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:11.887263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:11.887263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:11.887263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:11.887263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:11.887558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:11.887558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:11.912657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:11.963957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 952/1904] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:11.967877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.016246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 953/1905] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:12.020260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.038761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bf7b-80f8-45b1-b798-769b4b94ae74 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.098566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1245ad-3e0e-4986-be5e-008a02d8f1fa admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.104918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.105662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.106209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.106653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.107590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.109667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.129244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.129885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.130208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.130487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.131134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.133124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.320267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 954/1906] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:12 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:12.321985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.324085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:12.325491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 953/1907] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:11 2022] POST /identity/v3/users => generated 287 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:12.325618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:12.326762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.341765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57656e8-0e57-45b5-a820-5ffdab9e80b6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.348892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.350314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.350763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.351259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.352938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.355405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.371226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 954/1908] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:12.372508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.386105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4710ac-3d8f-4b43-b4bc-b0390f54db79 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.392796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.395549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.395549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.395549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.395549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.396793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.409352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 955/1909] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:12.410403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.421339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea36d16-af30-41a5-86e1-9fa3075cd680 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.422192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bc09d-a03a-46c8-8a58-deaebef96fb9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.426066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.426430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.426666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.426946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.427217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.427323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.427578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.427856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.427947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.429518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.429921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:12.439825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 956/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:12.443959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.445876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:12.458674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e863c04-2643-4d04-bfde-6227201eb7bc admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.463900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.464532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.464816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.465353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] PATH_INFO: `/v3/users/c1cde2698590405da91dd29b64c7a89f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.466596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cde2698590405da91dd29b64c7a89f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.468718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.512448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.513921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.525416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 955/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:12.526418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.543586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6ce5-67fa-4ba4-9bce-6648d08f4923 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.549866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.550573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.550884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.551178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.551835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.553816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.567258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 956/1912] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:12.568514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.582960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12ad1a-2e8e-448c-ac9c-874469551dac admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.593972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.595686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.595973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.597695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] PATH_INFO: `/v3/projects/ca24f6d041164fb0bc5a222a7e4d5a94/users/4648a70c92fa49fd81ecfbeba3f0e516/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.632785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca24f6d041164fb0bc5a222a7e4d5a94, user_id=4648a70c92fa49fd81ecfbeba3f0e516, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.637652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.701017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cde2698590405da91dd29b64c7a89f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:12.702730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cde2698590405da91dd29b64c7a89f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:12.717798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cde2698590405da91dd29b64c7a89f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:12.719104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cde2698590405da91dd29b64c7a89f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:12.737237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 957/1913] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:12 2022] PUT /identity/v3/projects/ca24f6d041164fb0bc5a222a7e4d5a94/users/4648a70c92fa49fd81ecfbeba3f0e516/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:12.738256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:12.741394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:12.754305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-00637810-290a-4560-a2e3-b33fa9d02ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cde2698590405da91dd29b64c7a89f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:12.828731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3eb90-2547-4549-b27d-c4dfedec4413 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:12.833663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:12.834490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.834868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.835217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] PATH_INFO: `/v3/projects/35d55a8607ad4a55bb69a43efd3f53c0/users/bd4288db335f4e2cb7b071bc8c34cccb/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.852378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 957/1914] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:12 2022] DELETE /identity/v3/users/c1cde2698590405da91dd29b64c7a89f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:12.858179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804c7e-f944-470a-a7a8-454854bdc5c9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.858179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804c7e-f944-470a-a7a8-454854bdc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.858179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3804c7e-f944-470a-a7a8-454854bdc5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.865021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d55a8607ad4a55bb69a43efd3f53c0, user_id=bd4288db335f4e2cb7b071bc8c34cccb, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:12.869054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbaf671-accf-47a0-8263-5e7a2c26611b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:12.901225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d3804c7e-f944-470a-a7a8-454854bdc5c9 None None] MFA Rules not processed for user `4648a70c92fa49fd81ecfbeba3f0e516`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:12.902604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d3804c7e-f944-470a-a7a8-454854bdc5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:12.975454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 958/1915] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:12 2022] PUT /identity/v3/projects/35d55a8607ad4a55bb69a43efd3f53c0/users/bd4288db335f4e2cb7b071bc8c34cccb/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:12.977639 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.978116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.978534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:12.983260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 958/1916] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:12.988544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:12.989175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:12.994198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.001627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:13.003073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.028012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] MFA Rules not processed for user `bd4288db335f4e2cb7b071bc8c34cccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:13.029516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.072130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 959/1917] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:13.072927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.075972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.110775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 959/1918] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:13.115397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.116963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.144497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb0a50-bd10-42d1-b117-4d2e69d0cbcd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.149429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.150130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.150657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.150794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.197354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44538ef8-0304-4bbc-a954-ec4808534a40 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.202334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.203077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.203359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.203767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.213516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.215059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.219728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.221505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.225621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 960/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:13.232005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 960/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:13.232979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.234341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.237166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.254754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda591e-c399-4728-86c5-2f9bf010cfe5 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.257594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.258605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e444cb-857d-4613-ac9b-803645a33cdf service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.258910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.259196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.259514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] PATH_INFO: `/v3/users/498d1d25b28e40178e4e872874d63458` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.260955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498d1d25b28e40178e4e872874d63458)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.262893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.267802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.269493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.271144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.272018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.272996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.276671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.418702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 961/1921] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:13 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:13.419722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.486681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218641-7ba2-4ad3-9fb1-cab10b610722 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.492457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.493568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.493843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.494172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.494937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.496874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.514836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498d1d25b28e40178e4e872874d63458'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:13.522728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498d1d25b28e40178e4e872874d63458'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:13.523826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498d1d25b28e40178e4e872874d63458'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:13.524381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498d1d25b28e40178e4e872874d63458'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:13.587516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 962/1922] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:13 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:13.591411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.593257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.604643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2e49e8af-91a0-4ccf-a065-bc8af834e2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498d1d25b28e40178e4e872874d63458'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:13.609957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fe8b0-e10a-4671-887d-ff136b1c50f5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.626521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.630521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.630521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.630521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.638973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.640203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 961/1923] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:13 2022] DELETE /identity/v3/users/498d1d25b28e40178e4e872874d63458 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:13.641085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.645440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.646093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.646466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.655684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 963/1924] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:13.660612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.683296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013008f-bb6e-4c9d-9927-fd800ce28887 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.690045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:13.690327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.800683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.801428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.801707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.802033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] PATH_INFO: `/v3/projects/397fa891845d4b8fa565f761664ddaa6/users/787e9b5fc93046da898abaa184ae8069/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.806490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 962/1925] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:13.808058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.809846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:13.829663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e299f98-572e-497b-8fc2-74e89dfd32aa None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:13.848851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=397fa891845d4b8fa565f761664ddaa6, user_id=787e9b5fc93046da898abaa184ae8069, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.849221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:13.850982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:13.851342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:13.851796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] PATH_INFO: `/v3/projects/7d1c802a1ab343aa9819df7ef73974c5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:13.853120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.853455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1c802a1ab343aa9819df7ef73974c5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:13.855871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:13.942599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:13.949147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 964/1926] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:13 2022] PUT /identity/v3/projects/397fa891845d4b8fa565f761664ddaa6/users/787e9b5fc93046da898abaa184ae8069/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:13.950293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:13.954865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.017812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60cfc3-bdc3-4613-8a1e-c7951df13cfa admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.033736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1c802a1ab343aa9819df7ef73974c5', 'request_id': 'req-d60df5c9-99ec-46d5-a9a2-14e448426368'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.046169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1c802a1ab343aa9819df7ef73974c5', 'request_id': 'req-d60df5c9-99ec-46d5-a9a2-14e448426368'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.055116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1c802a1ab343aa9819df7ef73974c5', 'request_id': 'req-d60df5c9-99ec-46d5-a9a2-14e448426368'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.084667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.085290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.085567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.086605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.108480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] The token cache is being invalidate because project 7d1c802a1ab343aa9819df7ef73974c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:14.108826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.109488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.111103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 963/1927] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:13 2022] DELETE /identity/v3/projects/7d1c802a1ab343aa9819df7ef73974c5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:14.114665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:14.116084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.149455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.150938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:14.160659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 965/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:14.163104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:14.176899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2dc73-2280-4865-8b6f-5959ffe55cc4 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.183167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.184494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.184893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.185109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] PATH_INFO: `/v3/users/bfc2e61bc94247188ffd90ca6c576814` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.186412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc2e61bc94247188ffd90ca6c576814)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.189335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:14.202052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60df5c9-99ec-46d5-a9a2-14e448426368 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.209847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.210509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.211365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.211640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.212400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.214210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:14.229640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 964/1929] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:14.230587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:14.243354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9f9a6-39ed-4f09-82de-2d036e4ed03c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.249202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.250135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.250466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.250744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] PATH_INFO: `/v3/projects/397fa891845d4b8fa565f761664ddaa6/users/787e9b5fc93046da898abaa184ae8069/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.252861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397fa891845d4b8fa565f761664ddaa6, user_id=787e9b5fc93046da898abaa184ae8069, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.255834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa2e4d-f01c-4a3a-9dce-e03690edc753 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:14.278040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 965/1930] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:14 2022] PUT /identity/v3/projects/397fa891845d4b8fa565f761664ddaa6/users/787e9b5fc93046da898abaa184ae8069/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:14.284913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.285347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.285670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.321028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] MFA Rules not processed for user `787e9b5fc93046da898abaa184ae8069`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:14.323905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.400613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 966/1931] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:14.412765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:14.414365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.459215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc2e61bc94247188ffd90ca6c576814'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.460379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc2e61bc94247188ffd90ca6c576814'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.471769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc2e61bc94247188ffd90ca6c576814'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.472572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc2e61bc94247188ffd90ca6c576814'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.491633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc2e61bc94247188ffd90ca6c576814'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:14.500857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:14.517611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77160f6-306c-4bd9-a43d-e75d28a88188 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.536692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.537378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.537671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.537972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.540265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.555278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.556745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:14.567093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 967/1932] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:14.604416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 966/1933] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:14 2022] DELETE /identity/v3/users/bfc2e61bc94247188ffd90ca6c576814 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:14.762582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:14.764652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:14.872881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b69b-b7fb-4c49-8e7f-7f43d26a059c service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:14.933851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:14.934588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:14.934941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:14.935288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] PATH_INFO: `/v3/projects/fe87377a2748439092cc2e3fb60cbdbf` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:14.936536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe87377a2748439092cc2e3fb60cbdbf)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:14.938703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.078764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe87377a2748439092cc2e3fb60cbdbf', 'request_id': 'req-f2721670-7ad1-49ff-b66a-bb2510f69c3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.085145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe87377a2748439092cc2e3fb60cbdbf', 'request_id': 'req-f2721670-7ad1-49ff-b66a-bb2510f69c3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.095022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe87377a2748439092cc2e3fb60cbdbf', 'request_id': 'req-f2721670-7ad1-49ff-b66a-bb2510f69c3a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.194287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] The token cache is being invalidate because project fe87377a2748439092cc2e3fb60cbdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:15.194649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.195278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.196911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 968/1934] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:14 2022] DELETE /identity/v3/projects/fe87377a2748439092cc2e3fb60cbdbf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:15.200849 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:15.211396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f343-72c6-42ac-8a11-f70e2ca72f8d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:15.227237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:15.229323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.277714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:15.278399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.278680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.278957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] PATH_INFO: `/v3/users/00f2ea00df024b1d8be93985bb47cc5b` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.280108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f2ea00df024b1d8be93985bb47cc5b)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:15.282382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.307169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2721670-7ad1-49ff-b66a-bb2510f69c3a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:15.311973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:15.312598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.312916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.313194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] PATH_INFO: `/v3/projects/58e87f8d2b6b4e8281ae24219cff1827` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.314336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e87f8d2b6b4e8281ae24219cff1827)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:15.316407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.604844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e87f8d2b6b4e8281ae24219cff1827', 'request_id': 'req-b487c4d6-2ad0-4178-961c-b5366dbbd2af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.610601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e87f8d2b6b4e8281ae24219cff1827', 'request_id': 'req-b487c4d6-2ad0-4178-961c-b5366dbbd2af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.615522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f2ea00df024b1d8be93985bb47cc5b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.616543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f2ea00df024b1d8be93985bb47cc5b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.617690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e87f8d2b6b4e8281ae24219cff1827', 'request_id': 'req-b487c4d6-2ad0-4178-961c-b5366dbbd2af'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.624956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f2ea00df024b1d8be93985bb47cc5b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.625665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f2ea00df024b1d8be93985bb47cc5b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.638340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f0d05184-5b88-423c-ba90-b879b9a8ac2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f2ea00df024b1d8be93985bb47cc5b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.737296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] The token cache is being invalidate because project 58e87f8d2b6b4e8281ae24219cff1827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:15.737591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.738673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:15.740206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 969/1935] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:15 2022] DELETE /identity/v3/projects/58e87f8d2b6b4e8281ae24219cff1827 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:15.740802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:15.742529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.808533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c4d6-2ad0-4178-961c-b5366dbbd2af admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:15.813148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:15.813853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.814168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.814446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] PATH_INFO: `/v3/users/bd4288db335f4e2cb7b071bc8c34cccb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.815576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4288db335f4e2cb7b071bc8c34cccb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:15.817489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:15.861013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 967/1936] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:15 2022] DELETE /identity/v3/users/00f2ea00df024b1d8be93985bb47cc5b => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:15.862219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043eb77-f355-4788-9ff6-b53ce096b463 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.862505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043eb77-f355-4788-9ff6-b53ce096b463 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.862781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043eb77-f355-4788-9ff6-b53ce096b463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.887967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d043eb77-f355-4788-9ff6-b53ce096b463 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:15.889183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d043eb77-f355-4788-9ff6-b53ce096b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:15.958179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 968/1937] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:15.966105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:15.966402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:15.966682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:15.993691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:15.995064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.005383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 969/1938] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:16.009952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.019206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c827b2-6980-4fb9-a5aa-f32407781e2d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.025063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.028758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.031556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.033603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.035715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:16.036028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.046072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.046246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4288db335f4e2cb7b071bc8c34cccb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.057982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 970/1939] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:16.062443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.072184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4288db335f4e2cb7b071bc8c34cccb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.074316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4288db335f4e2cb7b071bc8c34cccb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.075150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3099-e77f-44e3-ad46-0b72952e67f9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.078115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4288db335f4e2cb7b071bc8c34cccb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.081389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.082211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.082632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.083054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.083834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.086473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.153578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:16.186781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-37500876-3faf-44fd-85fa-0aa0e476b691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4288db335f4e2cb7b071bc8c34cccb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.197716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 971/1940] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:16 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:16.201752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.205289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.218280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 970/1941] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:15 2022] DELETE /identity/v3/users/bd4288db335f4e2cb7b071bc8c34cccb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:16.223779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.224155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.232256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.269676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:16.273390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.347211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b737c-6303-4e17-ad92-1e64ef45b098 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.383290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 971/1942] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:16.409806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.415469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.481670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:16.505433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51200c9-a73a-4b5e-9ff1-4529f2f0bde7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.510139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.510818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.511101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.511373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.511700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.512533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.512888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.513233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.513956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.516086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.523554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.531963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.548146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 972/1943] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:16.549232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.550948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.576678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92464-3a8c-4077-baf1-b94dbcae3057 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.585140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.586010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.586427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.586939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] PATH_INFO: `/v3/projects/3fb693de6b464db389666f8e6ce52c25` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.588798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb693de6b464db389666f8e6ce52c25)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.591897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.657231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 972/1944] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:16 2022] POST /identity/v3/users => generated 284 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:16.658538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.672634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3e257-e5de-4825-9a83-dc2d36a78a74 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.678354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.679034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.679255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.679563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.680224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.682049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.696857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 973/1945] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:16.700676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.710521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a12a5-6d62-4a00-94fb-c23fc914d17e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.714876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb693de6b464db389666f8e6ce52c25', 'request_id': 'req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.720152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb693de6b464db389666f8e6ce52c25', 'request_id': 'req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.731768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb693de6b464db389666f8e6ce52c25', 'request_id': 'req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.790836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.791874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.792167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.792497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.793240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.795406 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.815323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 974/1946] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:16.820209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:16.836570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abcaf5-3db6-4fc2-97b1-72ba6965ea65 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:16.842768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:16.848972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.848972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.848972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] PATH_INFO: `/v3/projects/2c00aacc3bd14f4c8b7fd52d4f997517/users/52186dc0639b4c8ea55954ec74ee9f4a/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.849326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] The token cache is being invalidate because project 3fb693de6b464db389666f8e6ce52c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:16.849326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.849326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0232d36-0eb3-4656-9cd9-dc949cd0f8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:16.853902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 973/1947] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:16 2022] DELETE /identity/v3/projects/3fb693de6b464db389666f8e6ce52c25 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:16.855455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a9e65-f664-4342-bc31-f08a3afc02b9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.855814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a9e65-f664-4342-bc31-f08a3afc02b9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.856097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a9e65-f664-4342-bc31-f08a3afc02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.903261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c00aacc3bd14f4c8b7fd52d4f997517, user_id=52186dc0639b4c8ea55954ec74ee9f4a, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:16.907944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-828a9e65-f664-4342-bc31-f08a3afc02b9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:16.909193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aed75-55c1-4516-aa1a-15e6c39348b4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:16.912771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-828a9e65-f664-4342-bc31-f08a3afc02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.937316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 974/1948] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:16.938996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:16.939407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:16.940196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:16.977537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:16.981004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:16.988436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 975/1949] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:16.993006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.004952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c0266-168e-414f-916a-dac80a600f91 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.014175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.014175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.014175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.014175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.014721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:17.014721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.016309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.049371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 976/1951] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:17.050416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.058098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 975/1951] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:16 2022] PUT /identity/v3/projects/2c00aacc3bd14f4c8b7fd52d4f997517/users/52186dc0639b4c8ea55954ec74ee9f4a/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:17.061446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.064623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.067220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.074381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d323a-6e7a-4eed-bfa4-945927ee6e5b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.130978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] MFA Rules not processed for user `52186dc0639b4c8ea55954ec74ee9f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:17.130978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.209168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.209826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.210141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.210483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.211791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.212234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 976/1952] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:17.213782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.215989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.219417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.249767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc9c22-7760-425a-b174-659f319d21e9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.255684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.256322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.256602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.256877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] PATH_INFO: `/v3/projects/35d55a8607ad4a55bb69a43efd3f53c0` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.258614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d55a8607ad4a55bb69a43efd3f53c0)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.260690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.385260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 977/1953] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:17 2022] POST /identity/v3/projects => generated 365 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:17.386051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.387660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.468619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d55a8607ad4a55bb69a43efd3f53c0', 'request_id': 'req-29b1c48d-ced8-43c1-b559-f06cf7abef52'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:17.481853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c930bf4-70ee-4066-9deb-c1b812c5139c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.575912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.576944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.577300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.577685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.578614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.580806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.598259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d55a8607ad4a55bb69a43efd3f53c0', 'request_id': 'req-29b1c48d-ced8-43c1-b559-f06cf7abef52'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:17.607610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d55a8607ad4a55bb69a43efd3f53c0', 'request_id': 'req-29b1c48d-ced8-43c1-b559-f06cf7abef52'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:17.610930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:17.623343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] The token cache is being invalidate because project 35d55a8607ad4a55bb69a43efd3f53c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:17.623866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:17.624758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:17.631361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 977/1954] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:17 2022] DELETE /identity/v3/projects/35d55a8607ad4a55bb69a43efd3f53c0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:17.633510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.635167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.649479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1c48d-ced8-43c1-b559-f06cf7abef52 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.655038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.655656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.655940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.656216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.656853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.658859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.755169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 978/1955] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:17 2022] POST /identity/v3/projects => generated 367 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:17.756158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.758763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.769028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 978/1956] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:17 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:17.769028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.771162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:17.784099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732bd7a-248d-4b8e-ad0e-8079de53bfee admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.831407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d20b86-6f0e-4f5a-9dce-6766d37f01cc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:17.836396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.837044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.837330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.838009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] PATH_INFO: `/v3/users/787e9b5fc93046da898abaa184ae8069` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.839171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] RBAC: Authorizing `identity:delete_user(user_id=787e9b5fc93046da898abaa184ae8069)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.841121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.845986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:17.846599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:17.846878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:17.847149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:17.847836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:17.849741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:17.968124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 979/1957] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:17 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:17.968975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:17.996311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7420-10b0-478a-a6cf-170af1ba71d9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.015699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.016327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.016607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.016882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.017540 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.019194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.032623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 980/1958] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:18.046290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.057543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2a5b5-8cfa-456a-a518-ff800eddbd65 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.065037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.065791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.067123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.067123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.067123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.068616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.082884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787e9b5fc93046da898abaa184ae8069'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.090119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 981/1959] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:18.090119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.098310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787e9b5fc93046da898abaa184ae8069'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.099445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787e9b5fc93046da898abaa184ae8069'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.099826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761083a3-9e12-44d8-a0d6-8c41ff16f24d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.100521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787e9b5fc93046da898abaa184ae8069'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.108037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.108655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.108933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.109922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.111195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.112819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.126948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 982/1960] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:18.128620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.131176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.141418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:18.158968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eebb05-4940-4013-a8c2-80839f45f87a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.165633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787e9b5fc93046da898abaa184ae8069'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.165798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.166672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.167020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.168850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] PATH_INFO: `/v3/projects/116db838f1d94b4a82d693fdb36bb286/users/1620f106f4254f7b9404c151dde826bf/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.188795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116db838f1d94b4a82d693fdb36bb286, user_id=1620f106f4254f7b9404c151dde826bf, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.192085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 979/1961] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:17 2022] DELETE /identity/v3/users/787e9b5fc93046da898abaa184ae8069 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:18.194851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.195537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.196637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.288252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc21230-3bb5-4321-986d-dc4acbed457b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.295076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.295754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.296035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.296313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] PATH_INFO: `/v3/projects/ccb46b851e4643948f2557132c25cead/users/32a143e8e7b245ae833d352be4396e24/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.314570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 983/1962] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:18 2022] PUT /identity/v3/projects/116db838f1d94b4a82d693fdb36bb286/users/1620f106f4254f7b9404c151dde826bf/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:18.315651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb46b851e4643948f2557132c25cead, user_id=32a143e8e7b245ae833d352be4396e24, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.318554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1df4a4-9bb8-4f79-a343-c7b7cd731d88 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.323527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.390471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249f68-14e1-4f95-8ae2-b286a03e2bf6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.395380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.396006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.396276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.401852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.401852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.401852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.409534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 984/1963] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:18.413633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.424361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8fdeb-6101-417a-924d-faba3b1b996e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.429702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.430412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.430705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.431143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] PATH_INFO: `/v3/projects/116db838f1d94b4a82d693fdb36bb286/users/1620f106f4254f7b9404c151dde826bf/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.435531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116db838f1d94b4a82d693fdb36bb286, user_id=1620f106f4254f7b9404c151dde826bf, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.435734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e4624-adf9-4731-bb85-3958bb0e4867 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.444987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 980/1964] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:18 2022] PUT /identity/v3/projects/ccb46b851e4643948f2557132c25cead/users/32a143e8e7b245ae833d352be4396e24/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:18.455231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.455581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.455973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.457304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 985/1965] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:18 2022] PUT /identity/v3/projects/116db838f1d94b4a82d693fdb36bb286/users/1620f106f4254f7b9404c151dde826bf/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:18.469530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.469812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.470133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.491941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] MFA Rules not processed for user `32a143e8e7b245ae833d352be4396e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:18.493087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.501800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] MFA Rules not processed for user `1620f106f4254f7b9404c151dde826bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:18.503290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.582341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 981/1966] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:18.587339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.602947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 986/1967] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:18.615169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.616706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.643643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:18.668505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8763c2b-c39e-4503-9f61-f53cb5fd0601 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.683787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.684389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.684722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.685028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.685850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.687840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.699686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75c14-16ef-4cd2-8d7f-4ab91a515b7a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.704610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.705535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.705822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.706123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.720884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.722438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.734155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 987/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:18.739048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.740824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:18.765334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2a03-3835-473c-8093-4080ba0b15bc service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.774426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.779254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.779254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.779254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] PATH_INFO: `/v3/projects/397fa891845d4b8fa565f761664ddaa6` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.779254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=397fa891845d4b8fa565f761664ddaa6)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.783816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.813806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 982/1969] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:18 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:18.813806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:18.883453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be2738-12f6-4bc9-8c10-1d51e92eb3a8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:18.888286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:18.888894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:18.889174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:18.889983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:18.890136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:18.892076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:18.940513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397fa891845d4b8fa565f761664ddaa6', 'request_id': 'req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:18.979797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 983/1970] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:18 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:18.985314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.000095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397fa891845d4b8fa565f761664ddaa6', 'request_id': 'req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.008868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d849-a84e-4df3-b396-ee710a48eebe admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.009304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397fa891845d4b8fa565f761664ddaa6', 'request_id': 'req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.024938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] The token cache is being invalidate because project 397fa891845d4b8fa565f761664ddaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:19.025614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.028307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8919b5ed-2f03-4123-b3c3-5c1e61c3a31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.034239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 988/1971] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:18 2022] DELETE /identity/v3/projects/397fa891845d4b8fa565f761664ddaa6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:19.039016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20101-431f-4ba2-bde3-226e79ab5116 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.039546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20101-431f-4ba2-bde3-226e79ab5116 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.040007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a20101-431f-4ba2-bde3-226e79ab5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.060999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-75a20101-431f-4ba2-bde3-226e79ab5116 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:19.062297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-75a20101-431f-4ba2-bde3-226e79ab5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.083698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.084314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.084594 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.084870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.085550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.087332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.097396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 984/1972] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:19.101570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.103411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.116458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588cde-ca9b-4f2c-9511-7757cbeb9b90 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.122007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.122702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.123002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.123270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] PATH_INFO: `/v3/projects/1779935778bd4d6397f6f2899649d04e/users/ecd7109c93374a66a866ed86c3d09914/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.128772 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 989/1973] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:19.138288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.138578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.138860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.140533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779935778bd4d6397f6f2899649d04e, user_id=ecd7109c93374a66a866ed86c3d09914, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.143435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.157777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:19.159010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.167049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 990/1974] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:19.171064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.180499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03b3dc-8bed-4484-a387-b76aa383e930 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.185113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.185745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.186063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.186339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.186991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:19.187293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.188896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.209564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 991/1975] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:19.211254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.226124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15351851-b962-4627-ba48-f0964178f210 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.235009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.235693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.235996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.236241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.236874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.238856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.268566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 985/1976] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:19 2022] PUT /identity/v3/projects/1779935778bd4d6397f6f2899649d04e/users/ecd7109c93374a66a866ed86c3d09914/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:19.268566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.274566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.336847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e62e94-27e0-42e7-8962-f9136721c450 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.341605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.342264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.342545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.342818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] PATH_INFO: `/v3/users/4648a70c92fa49fd81ecfbeba3f0e516` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.344017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4648a70c92fa49fd81ecfbeba3f0e516)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.345958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.381097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 992/1977] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:19.382438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.385381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.467965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00d78-96d1-45bf-a957-0803953f916d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.472878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.473521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.473804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.474111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] PATH_INFO: `/v3/users/95053819fe5a4e81857608cdc5b39c1f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.475283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95053819fe5a4e81857608cdc5b39c1f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.478262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.676951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4648a70c92fa49fd81ecfbeba3f0e516'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.684030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4648a70c92fa49fd81ecfbeba3f0e516'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.684827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4648a70c92fa49fd81ecfbeba3f0e516'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.685583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4648a70c92fa49fd81ecfbeba3f0e516'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.742473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95053819fe5a4e81857608cdc5b39c1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.743118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95053819fe5a4e81857608cdc5b39c1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.750283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95053819fe5a4e81857608cdc5b39c1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.750941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95053819fe5a4e81857608cdc5b39c1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.762494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95053819fe5a4e81857608cdc5b39c1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.775719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4648a70c92fa49fd81ecfbeba3f0e516'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:19.794025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 986/1978] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:19 2022] DELETE /identity/v3/users/4648a70c92fa49fd81ecfbeba3f0e516 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:19.794766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.796094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.862819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00011cfb-0769-4c89-9f7e-ef12d7e4adef admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.867681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.868758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.869261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.869634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.871082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.872832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629290-b177-41ff-b08f-cab09361f58e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.873591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 993/1979] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:19 2022] DELETE /identity/v3/users/95053819fe5a4e81857608cdc5b39c1f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:19.874266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:19.875622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.888778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 987/1980] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:19.888778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696409ce-f078-4889-b046-2c75aedc61ea None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.888778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696409ce-f078-4889-b046-2c75aedc61ea None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.888778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696409ce-f078-4889-b046-2c75aedc61ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.911238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-696409ce-f078-4889-b046-2c75aedc61ea None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:19.912446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-696409ce-f078-4889-b046-2c75aedc61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:19.948505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868b38-fad0-4db1-ba1f-5f1175a2465b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:19.953266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:19.953865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.954178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.954446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.955069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:19.957029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:19.971731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 988/1981] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:19.973009 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:19.973293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:19.973563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:19.992285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:19.993714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.001873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 989/1982] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:20.002868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.004113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.018846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982da14c-8419-4b8e-8a4b-bcc74a8abd9e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.024231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.024878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.025162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.025432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] PATH_INFO: `/v3/projects/1779935778bd4d6397f6f2899649d04e/users/ecd7109c93374a66a866ed86c3d09914/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.027390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779935778bd4d6397f6f2899649d04e, user_id=ecd7109c93374a66a866ed86c3d09914, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.030015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.043817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 990/1983] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:20 2022] PUT /identity/v3/projects/1779935778bd4d6397f6f2899649d04e/users/ecd7109c93374a66a866ed86c3d09914/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:20.050940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.053676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.076368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 994/1984] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:19 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:20.077237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.080739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.152130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fc1fb-ab05-41a1-94ff-cd2a78b0c752 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.156314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f092870-6da5-4861-a1e1-1f831068026b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.159601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.160235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.160508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.160782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.165894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.166673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.166996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.167265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.262141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.262141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3112ad8-e497-4d73-843d-2438e5fcdc42 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.262411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.262411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.267146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 995/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:20.268383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.268666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.268940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.278535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 991/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:20.279415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.301578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802173c-d06a-4913-8144-65d4bb7d8c5e service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.313670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.314845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.314845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.314845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.315674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.317284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.319714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] MFA Rules not processed for user `ecd7109c93374a66a866ed86c3d09914`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:20.322635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.337873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 992/1987] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:20.344502 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.364628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544ee5d-b01f-43ff-bad8-296a105dfd3e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.376964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.377593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.377874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.378181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.379046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.380646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.394991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 993/1988] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:20.400119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.407560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24377-3e89-45bc-8160-367589bb006f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.412355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.413021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.413299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.413574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] PATH_INFO: `/v3/projects/d96d6776fea74d3ba0b9ed599c5f5bf6/users/ffc738cf283049f0b667dfd54b6f134f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.423235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 996/1989] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:20.436373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.438066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.440823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96d6776fea74d3ba0b9ed599c5f5bf6, user_id=ffc738cf283049f0b667dfd54b6f134f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.444561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.471821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:20.511455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab190-4475-4757-9f31-05c471a7e4d5 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.515133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.515748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.516030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.516614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.526872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.528331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf0c1-5d8b-477f-bb12-59540d163354 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:20.539185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 997/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:20.583016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 994/1991] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:20 2022] PUT /identity/v3/projects/d96d6776fea74d3ba0b9ed599c5f5bf6/users/ffc738cf283049f0b667dfd54b6f134f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:20.595217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.595506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.595788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.636501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] MFA Rules not processed for user `ffc738cf283049f0b667dfd54b6f134f`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:20.637798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:20.754747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 998/1992] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:20.759855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.918369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:20.918536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd3146-c57f-4ebd-b27d-05f862cb3060 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:20.924198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:20.924830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:20.925112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:20.925388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:20.926077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:20.928051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.012826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084aca-7e73-4414-919f-af5e91d2a16c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.017696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.018367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.018647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.018923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.021579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:21.076482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 995/1993] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:20 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:21.082089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.150241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.151958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.158505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4398d-44e7-4c7f-a812-d3eb868c552b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.169581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.169581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.169581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.169581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.170042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.172497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.173533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 999/1994] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:21.288660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 996/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:21 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:21.288816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.288816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:21.296886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.317236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a99b7-679e-45b1-8fef-2afb2141502e service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.323342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.324100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.325124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.325124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] PATH_INFO: `/v3/projects/eb2a581b5585424f8c1a8cb618ad873e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.326141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2a581b5585424f8c1a8cb618ad873e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.328334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.330152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0365c-cbfe-409e-94fd-9964b719b67c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.336568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.337347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.339522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.339522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.340296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.343016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.375780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 997/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:21.376741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.379062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:21.395321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a0f4f-3eae-456f-8e0f-0e961770224d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.400447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.401190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.401573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.401973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] PATH_INFO: `/v3/projects/ca24f6d041164fb0bc5a222a7e4d5a94` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.403200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca24f6d041164fb0bc5a222a7e4d5a94)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.405209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.553203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:21.568618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2a581b5585424f8c1a8cb618ad873e', 'request_id': 'req-a4bcd339-fbf3-4674-a15d-03344f5c00cb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.584359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca24f6d041164fb0bc5a222a7e4d5a94', 'request_id': 'req-be883e1c-eb26-4368-935e-db5fa141e94a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.590524 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca24f6d041164fb0bc5a222a7e4d5a94', 'request_id': 'req-be883e1c-eb26-4368-935e-db5fa141e94a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.597911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca24f6d041164fb0bc5a222a7e4d5a94', 'request_id': 'req-be883e1c-eb26-4368-935e-db5fa141e94a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.643238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2a581b5585424f8c1a8cb618ad873e', 'request_id': 'req-a4bcd339-fbf3-4674-a15d-03344f5c00cb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.652043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2a581b5585424f8c1a8cb618ad873e', 'request_id': 'req-a4bcd339-fbf3-4674-a15d-03344f5c00cb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.667666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] The token cache is being invalidate because project eb2a581b5585424f8c1a8cb618ad873e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:21.667955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.668712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.673205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1000/1997] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:21 2022] DELETE /identity/v3/projects/eb2a581b5585424f8c1a8cb618ad873e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:21.681737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.683534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:21.765558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] The token cache is being invalidate because project ca24f6d041164fb0bc5a222a7e4d5a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:21.766010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.769084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:21.774569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 998/1998] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:21 2022] DELETE /identity/v3/projects/ca24f6d041164fb0bc5a222a7e4d5a94 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:21.774569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:21.787273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:21.800479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcd339-fbf3-4674-a15d-03344f5c00cb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.887659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883e1c-eb26-4368-935e-db5fa141e94a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:21.888379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.889326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.890427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.892120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] PATH_INFO: `/v3/projects/97c2501c668f416b8295fe3f2b58c034/users/069b71ca15af4514934e4e0dd13e7281/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.904107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:21.904986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:21.905458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:21.905986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] PATH_INFO: `/v3/users/ec5e6056f8b84e4cb53079c6e0cac483` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:21.908424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5e6056f8b84e4cb53079c6e0cac483)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.910504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:21.918351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c2501c668f416b8295fe3f2b58c034, user_id=069b71ca15af4514934e4e0dd13e7281, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:21.921357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9beb42-4329-492d-9a7a-dcd115e1790e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.094736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1001/1999] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:21 2022] PUT /identity/v3/projects/97c2501c668f416b8295fe3f2b58c034/users/069b71ca15af4514934e4e0dd13e7281/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:22.097658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.097959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.098245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.132397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:22.133905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.214905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1002/2000] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:22.216179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.217414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5e6056f8b84e4cb53079c6e0cac483'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:22.218196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.235310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aefd72-4d9a-4fe6-be26-c75efb3f204c None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.241076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.241828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.242460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.242853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.243991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.245843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7e070-e87a-40dc-8890-fbcc92955713 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.256732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5e6056f8b84e4cb53079c6e0cac483'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:22.260318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5e6056f8b84e4cb53079c6e0cac483'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:22.260318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5e6056f8b84e4cb53079c6e0cac483'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:22.272475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1003/2001] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:22.278465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.281603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.282026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.312292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:22.313636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.326081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1004/2002] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:22.327010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.328362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.341107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f4a32-3740-46c5-ae8f-aa24d4df00e9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.341846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6d26ce22-6d8c-420a-9f30-109ef4826dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5e6056f8b84e4cb53079c6e0cac483'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:22.346143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.346804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.347086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.347366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] PATH_INFO: `/v3/projects/97c2501c668f416b8295fe3f2b58c034/users/069b71ca15af4514934e4e0dd13e7281/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.349386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c2501c668f416b8295fe3f2b58c034, user_id=069b71ca15af4514934e4e0dd13e7281, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.352149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.363110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1005/2003] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:22 2022] PUT /identity/v3/projects/97c2501c668f416b8295fe3f2b58c034/users/069b71ca15af4514934e4e0dd13e7281/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:22.363358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 999/2004] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:21 2022] DELETE /identity/v3/users/ec5e6056f8b84e4cb53079c6e0cac483 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:22.366580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.375578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.375874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.386318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:22.387159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.456715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] MFA Rules not processed for user `069b71ca15af4514934e4e0dd13e7281`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:22.457980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.460315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6c81-9eba-4d44-ab31-1bec397f68fa admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.560479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.563921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.564295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.564872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.565771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1000/2005] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:22.566051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:22.566560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.568834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.575031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.577284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:22.613093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1006/2006] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:22.620822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.655318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6b97d-0109-4729-816d-2ed16012c796 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.669546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.670348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.671147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.671551 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.672275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.674364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.721694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f9d90-5705-48dd-ba40-77185338ab31 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.733650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.734353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.748485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.748485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.749746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.751361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:22.776086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1001/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:22.816390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.818891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1007/2008] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:22 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:22.833576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:22.835526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba499a-a71c-4c45-b2ed-bb8a52365148 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.951232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b304dc1-8085-4f8a-a5fa-86215e72eba1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:22.956811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:22.957556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:22.963514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:22.963514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] PATH_INFO: `/v3/users/ffc738cf283049f0b667dfd54b6f134f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:22.963514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc738cf283049f0b667dfd54b6f134f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:22.963514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.004077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:23.004770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.005055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.005329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.008528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:23.013764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.116028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1002/2009] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:22 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:23.116999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:23.125344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:23.170984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4981e-a2e7-49b2-bba0-2f7815b66ab3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:23.183820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:23.187103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.187103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.187103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] PATH_INFO: `/v3/projects/374d4d5053e24b6dbdfcadf2fd1241a5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.189498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] RBAC: Authorizing `identity:delete_project(project_id=374d4d5053e24b6dbdfcadf2fd1241a5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:23.194382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.215664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc738cf283049f0b667dfd54b6f134f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.218015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc738cf283049f0b667dfd54b6f134f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.237160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc738cf283049f0b667dfd54b6f134f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.237902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc738cf283049f0b667dfd54b6f134f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.277792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc738cf283049f0b667dfd54b6f134f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.469105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374d4d5053e24b6dbdfcadf2fd1241a5', 'request_id': 'req-17b6fb48-0f96-45c8-ab38-458cc77d757b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.487614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1008/2010] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:22 2022] DELETE /identity/v3/users/ffc738cf283049f0b667dfd54b6f134f => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:23.488804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:23.490453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374d4d5053e24b6dbdfcadf2fd1241a5', 'request_id': 'req-17b6fb48-0f96-45c8-ab38-458cc77d757b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.492886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:23.512711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374d4d5053e24b6dbdfcadf2fd1241a5', 'request_id': 'req-17b6fb48-0f96-45c8-ab38-458cc77d757b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.626050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014ce4-01ec-4b4e-be97-abe6c1e5b6d2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:23.634190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:23.634826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.635100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.635369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.636034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:23.637883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55e445-a14d-4911-b485-c0aa52cd065d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.676357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1009/2011] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:23.679580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.681148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.682847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.685040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] The token cache is being invalidate because project 374d4d5053e24b6dbdfcadf2fd1241a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:23.686780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.691013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:23.693712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1003/2012] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:23 2022] DELETE /identity/v3/projects/374d4d5053e24b6dbdfcadf2fd1241a5 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:23.696625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:23.698625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:23.708909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:23.728652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:23.731477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:23.741953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1010/2013] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:23.745654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:23.747398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:23.765411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c55a-e2d0-4b6f-bcb5-b52c063834df None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:23.771064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:23.772552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.773050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.773462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] PATH_INFO: `/v3/users/202f298d0c76483b957a1682ae771dbd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.775963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202f298d0c76483b957a1682ae771dbd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:23.778191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.888003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fb48-0f96-45c8-ab38-458cc77d757b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:23.899095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:23.899737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:23.900023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:23.900330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:23.901125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:23.903678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:23.921691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1004/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:23.923100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:23.925141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.044635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202f298d0c76483b957a1682ae771dbd'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.046318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202f298d0c76483b957a1682ae771dbd'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.054018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74c82-0283-423d-b256-1ba03651f496 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:24.059805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202f298d0c76483b957a1682ae771dbd'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.060553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202f298d0c76483b957a1682ae771dbd'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.063885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:24.064525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.064807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.065085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.070480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.079914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202f298d0c76483b957a1682ae771dbd'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.111149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:24.112695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:24.130409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1005/2015] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:24.130409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.130409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.143735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78f1c8-3fdd-4daa-98f7-4720ceaae049 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:24.149889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:24.150745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.151051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.151752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] PATH_INFO: `/v3/users/52186dc0639b4c8ea55954ec74ee9f4a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.153486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52186dc0639b4c8ea55954ec74ee9f4a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:24.155748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:24.170741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1011/2016] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:23 2022] DELETE /identity/v3/users/202f298d0c76483b957a1682ae771dbd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:24.170741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.181008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.306242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9f1c1-258a-471c-af81-2abdba035f10 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:24.327231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:24.328175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.328604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.329034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] PATH_INFO: `/v3/projects/ae0f3abd99a24a538fa5e7657d1a0462/users/baccb60a6e2041f6934db1a0ef931a55/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.354889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0f3abd99a24a538fa5e7657d1a0462, user_id=baccb60a6e2041f6934db1a0ef931a55, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:24.359200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0fd7b-b735-4279-961b-d63504dba0e1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:24.448348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:24.463113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1012/2017] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:24 2022] PUT /identity/v3/projects/ae0f3abd99a24a538fa5e7657d1a0462/users/baccb60a6e2041f6934db1a0ef931a55/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:24.474832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.474832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.475083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.498205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52186dc0639b4c8ea55954ec74ee9f4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.506584 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52186dc0639b4c8ea55954ec74ee9f4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.507521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52186dc0639b4c8ea55954ec74ee9f4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.509778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52186dc0639b4c8ea55954ec74ee9f4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.539002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] MFA Rules not processed for user `baccb60a6e2041f6934db1a0ef931a55`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:24.540305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.587530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-aafce12f-c432-4af5-978c-b3f546c5515e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52186dc0639b4c8ea55954ec74ee9f4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:24.610419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1006/2018] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:24 2022] DELETE /identity/v3/users/52186dc0639b4c8ea55954ec74ee9f4a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:24.614708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.615969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.616580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.646505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1013/2019] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:24.650984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.652378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:24.653290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.654668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.757125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1007/2020] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:24.761322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e77f-1c99-4f49-aeab-54c1fbb1c32e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:24.770240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:24.772583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.772925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.773212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.777577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:24.779681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:24.782599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.786593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.880544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c662b-31b1-4250-9765-ee02c9ed22ba None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:24.885322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:24.886127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:24.886311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:24.886989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:24.901322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:24.902802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:24.916951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1008/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:24.918207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.920247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.924942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1014/2022] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:24 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:24.924942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:24.927779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:24.945999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06a07-796b-4134-b214-bb649bdd1201 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.012903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248dbb2-b70c-4eaf-9060-04b8e853b6dd admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.018697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.019353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.019651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.020037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] PATH_INFO: `/v3/projects/d96d6776fea74d3ba0b9ed599c5f5bf6` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.021254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96d6776fea74d3ba0b9ed599c5f5bf6)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.023197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.027606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.028412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.028710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.029995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] PATH_INFO: `/v3/projects/1eb1b87cda104e28aadba778a22381e4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.030268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb1b87cda104e28aadba778a22381e4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.032542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.120174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96d6776fea74d3ba0b9ed599c5f5bf6', 'request_id': 'req-06c09b10-3065-4655-9fdb-0ed0e70d7b06'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.142803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb1b87cda104e28aadba778a22381e4', 'request_id': 'req-57eb1e6c-82b9-48df-b0ab-2130b00b057b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.148499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb1b87cda104e28aadba778a22381e4', 'request_id': 'req-57eb1e6c-82b9-48df-b0ab-2130b00b057b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.155282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb1b87cda104e28aadba778a22381e4', 'request_id': 'req-57eb1e6c-82b9-48df-b0ab-2130b00b057b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.187634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96d6776fea74d3ba0b9ed599c5f5bf6', 'request_id': 'req-06c09b10-3065-4655-9fdb-0ed0e70d7b06'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.194546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96d6776fea74d3ba0b9ed599c5f5bf6', 'request_id': 'req-06c09b10-3065-4655-9fdb-0ed0e70d7b06'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.205503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] The token cache is being invalidate because project d96d6776fea74d3ba0b9ed599c5f5bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:25.205837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.206564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.211132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1015/2023] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:24 2022] DELETE /identity/v3/projects/d96d6776fea74d3ba0b9ed599c5f5bf6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:25.211132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.211132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.273836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09b10-3065-4655-9fdb-0ed0e70d7b06 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.278367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] The token cache is being invalidate because project 1eb1b87cda104e28aadba778a22381e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:25.278675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.279364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.281051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1009/2024] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:24 2022] DELETE /identity/v3/projects/1eb1b87cda104e28aadba778a22381e4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:25.281823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.283265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.335951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.337130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.337423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.337682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.338351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.340287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988ab9-f95e-48c1-a76a-b1f6f66b7686 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.369300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1e6c-82b9-48df-b0ab-2130b00b057b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.374270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.375032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.375310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.375589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] PATH_INFO: `/v3/users/069b71ca15af4514934e4e0dd13e7281` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.376789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069b71ca15af4514934e4e0dd13e7281)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.378816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.387153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:25.504963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1016/2025] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:25 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:25.504963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.504963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.504963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.522296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:25.523482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.531305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1017/2026] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:25.532063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.533256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.545178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c713f15-d931-420b-9861-ff4f0734cf17 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.550159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.550750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.551028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.551299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.551938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.553614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718969de-e136-4bfd-aa4e-2d62ab6ac944 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.564050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1018/2027] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:25.568720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.568720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.568720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.584509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:25.585825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.593811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1019/2028] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:25.594630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.605207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1516f-71be-4084-b3e3-7eeef7171f4d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.611266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.611886 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.612162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.612424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.613069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.617208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.626296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:25.627131 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.636786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d616-4f05-4da3-a327-45ad59c1fa37 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.641864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.642569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.642793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.643080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.643715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:25.644018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.645897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.659199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069b71ca15af4514934e4e0dd13e7281'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.660393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1021/2030] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:25.662019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.663881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.672382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069b71ca15af4514934e4e0dd13e7281'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.673240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069b71ca15af4514934e4e0dd13e7281'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.674023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069b71ca15af4514934e4e0dd13e7281'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.681176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5ea2-c5e4-4745-b701-731549457aeb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.686112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.686742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.687138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.687419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] PATH_INFO: `/v3/projects/2c00aacc3bd14f4c8b7fd52d4f997517` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.688543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c00aacc3bd14f4c8b7fd52d4f997517)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.690498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.762940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069b71ca15af4514934e4e0dd13e7281'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.780694 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1010/2031] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:25 2022] DELETE /identity/v3/users/069b71ca15af4514934e4e0dd13e7281 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:25.783768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.783768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.811947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c00aacc3bd14f4c8b7fd52d4f997517', 'request_id': 'req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.853287 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26512260-b919-4859-bbcf-9506b331d128 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.878367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c00aacc3bd14f4c8b7fd52d4f997517', 'request_id': 'req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.886489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c00aacc3bd14f4c8b7fd52d4f997517', 'request_id': 'req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.898454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] The token cache is being invalidate because project 2c00aacc3bd14f4c8b7fd52d4f997517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:25.899445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.900442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:25.903156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1022/2032] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:25 2022] DELETE /identity/v3/projects/2c00aacc3bd14f4c8b7fd52d4f997517 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:25.904150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.906266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:25.909596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.916733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.916733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.916733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] PATH_INFO: `/v3/projects/0688f0874dd4404f904e2177ea948c49/users/afd970e489a54880a8eb65810e666f02/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.918930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2eac7-2163-42d1-84dc-1a06153d0ac5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:25.923638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:25.924233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:25.924515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:25.924846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:25.925472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.925592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0688f0874dd4404f904e2177ea948c49, user_id=afd970e489a54880a8eb65810e666f02, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:25.927631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.928223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:25.987831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1011/2033] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:25 2022] PUT /identity/v3/projects/0688f0874dd4404f904e2177ea948c49/users/afd970e489a54880a8eb65810e666f02/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:25.989114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:25.990748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.044442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1023/2034] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:25 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:26.045680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:26.047809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.067465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb95a8-735b-4f51-be6b-6b56cdb26d6a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:26.127690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:26.128499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.128623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.128889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] PATH_INFO: `/v3/users/32a143e8e7b245ae833d352be4396e24` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.130116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a143e8e7b245ae833d352be4396e24)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:26.132107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:26.137113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786185a-af4b-42f4-a137-e7177a30d38d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:26.143941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:26.144848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.145361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.145852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] PATH_INFO: `/v3/users/1620f106f4254f7b9404c151dde826bf` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.147434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1620f106f4254f7b9404c151dde826bf)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:26.149805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:26.404656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:26.409000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a143e8e7b245ae833d352be4396e24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.416348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a143e8e7b245ae833d352be4396e24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.417015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a143e8e7b245ae833d352be4396e24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.417644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1620f106f4254f7b9404c151dde826bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.417759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a143e8e7b245ae833d352be4396e24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.418300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1620f106f4254f7b9404c151dde826bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.425444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1620f106f4254f7b9404c151dde826bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.426135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1620f106f4254f7b9404c151dde826bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.437614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1620f106f4254f7b9404c151dde826bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.507203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7eb4bf58-feb4-45fd-968f-bea269fd6cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a143e8e7b245ae833d352be4396e24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.525453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1012/2035] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:25 2022] DELETE /identity/v3/users/32a143e8e7b245ae833d352be4396e24 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:26.526808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.527101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.527381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.555857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] MFA Rules not processed for user `afd970e489a54880a8eb65810e666f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:26.557089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.624678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1013/2036] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:26.625617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:26.629761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1024/2037] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:26 2022] DELETE /identity/v3/users/1620f106f4254f7b9404c151dde826bf => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:26.629902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.630120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:26.632647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.698961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6809fc-34b3-40b9-be63-1bd9f6864b85 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:26.713708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2b371-2286-472a-95d1-a3d59f0af915 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:26.718573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:26.719210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.719485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.720111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] PATH_INFO: `/v3/projects/97c2501c668f416b8295fe3f2b58c034` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.720967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c2501c668f416b8295fe3f2b58c034)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:26.723051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:26.759064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:26.759672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.759950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.760222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.760833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:26.762804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7e13b-9ea3-4abb-8e1b-34242f157cdf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:26.880933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1014/2038] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:26 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:26.882514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.882798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.883625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.888412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c2501c668f416b8295fe3f2b58c034', 'request_id': 'req-9c502567-9177-417f-b9f1-db5da13a5fb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.903670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:26.904912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.966526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1015/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:26.967371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:26.968692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:26.976288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c2501c668f416b8295fe3f2b58c034', 'request_id': 'req-9c502567-9177-417f-b9f1-db5da13a5fb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.981414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6285e-22bf-4b53-b4b5-bb45f62f01be None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:26.983909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c2501c668f416b8295fe3f2b58c034', 'request_id': 'req-9c502567-9177-417f-b9f1-db5da13a5fb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.987764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:26.991872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:26.991872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:26.991872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:26.991872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:26.992211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:26.998168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] The token cache is being invalidate because project 97c2501c668f416b8295fe3f2b58c034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:26.998465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:26.999190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.000773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1025/2040] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:26 2022] DELETE /identity/v3/projects/97c2501c668f416b8295fe3f2b58c034 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:27.004960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.006359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.018839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c502567-9177-417f-b9f1-db5da13a5fb0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.023848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.024527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.024863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.025195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.025924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.027563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.037222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1026/2041] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:27.038015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.040179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.095279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34483-980f-4a41-bd5a-8572b524ee39 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.098841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.099433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.099713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.100083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.101748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.113673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.115122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290043c8-8996-4389-9be2-c82b7d62954e service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.125865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1027/2042] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:27.127059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.127326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.127603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.144095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1016/2043] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:26 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:27.145413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.159958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:27.161262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.220664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce384bc3-6f12-4943-a3f7-caa093a96685 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.225738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.226391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.226678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.228260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.228861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.230760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.238157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1028/2044] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:27.239201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.240480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.245682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1017/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:27.246681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.248504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.253649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff849ed-f6fa-47dc-be38-17fdeb2ba875 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.258622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.259245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.259523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.259867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] PATH_INFO: `/v3/projects/116db838f1d94b4a82d693fdb36bb286` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.260940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=116db838f1d94b4a82d693fdb36bb286)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.261864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c3882-be6b-4f81-8431-7e73254cbbfc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.263008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.267293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.267932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.268178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.268588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.269350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.271379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f545f-47fa-45fd-a9f6-e440b01c0f05 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.393982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1018/2046] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:27 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:27.395552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.396203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.396764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.420589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:27.422006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.431546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1019/2047] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:27.432360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.449153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ffb2-4090-40c6-a2d8-1b7208f1f3b1 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.455559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.455559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.455559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.455559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] PATH_INFO: `/v3/projects/3858a1cc836046b5b89e87f21285fc17/users/b02ac305a83e4c58a3b12c739b64e237/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.472146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3858a1cc836046b5b89e87f21285fc17, user_id=b02ac305a83e4c58a3b12c739b64e237, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.474997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.484417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:27.580716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1020/2048] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:27 2022] PUT /identity/v3/projects/3858a1cc836046b5b89e87f21285fc17/users/b02ac305a83e4c58a3b12c739b64e237/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:27.581919 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.597134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116db838f1d94b4a82d693fdb36bb286', 'request_id': 'req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.646013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f132be6-f6ba-4df2-84c3-1e8b0a57c81e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.678828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116db838f1d94b4a82d693fdb36bb286', 'request_id': 'req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.685985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116db838f1d94b4a82d693fdb36bb286', 'request_id': 'req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.699360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] The token cache is being invalidate because project 116db838f1d94b4a82d693fdb36bb286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:27.699794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.700532 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:27.703215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1029/2049] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:27 2022] DELETE /identity/v3/projects/116db838f1d94b4a82d693fdb36bb286 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:27.703593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.705201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.721869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.722577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.722860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.723133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.723785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.725386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2c76f-d64d-4f28-b41f-c3b9a316689d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.738818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:27.740326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1021/2050] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:27.741786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2d94-95b4-4e60-ac68-fa068a890c9a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.742067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2d94-95b4-4e60-ac68-fa068a890c9a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.742347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea2d94-95b4-4e60-ac68-fa068a890c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.763160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-34ea2d94-95b4-4e60-ac68-fa068a890c9a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:27.765542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-34ea2d94-95b4-4e60-ac68-fa068a890c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.776761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579b9c-92ee-46ea-b3fd-43fe3d35a44c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.780436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1022/2051] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:27.781751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.782161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.782442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.787509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.788129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.788413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.788689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.790700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:27.790700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.791658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.804322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:27.806193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1030/2052] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:27.813308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.813424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.813424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.815261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1023/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:27.816013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.817498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:27.827207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef36138-8a95-4694-98d4-902675df478e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.832808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.833510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.833796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.834165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] PATH_INFO: `/v3/projects/ae97625b1dae482684bee961923b0e0f/users/9570707432b0462f863195faa533ff57/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.839394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942cae8-4bc5-49b1-9713-6ef0a4cce4ba None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:27.845538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:27.846331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:27.846688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:27.847233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] PATH_INFO: `/v3/projects/ccb46b851e4643948f2557132c25cead` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:27.849284 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb46b851e4643948f2557132c25cead)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.851731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.855462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae97625b1dae482684bee961923b0e0f, user_id=9570707432b0462f863195faa533ff57, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:27.858183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:27.964928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1031/2054] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:27 2022] PUT /identity/v3/projects/ae97625b1dae482684bee961923b0e0f/users/9570707432b0462f863195faa533ff57/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:27.965774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:27.967607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.009230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb46b851e4643948f2557132c25cead', 'request_id': 'req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.015431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb46b851e4643948f2557132c25cead', 'request_id': 'req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.022033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb46b851e4643948f2557132c25cead', 'request_id': 'req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.033528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f048-954e-4902-973a-2e8dada6d6cf admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.093906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.095530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.097727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.101722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] The token cache is being invalidate because project ccb46b851e4643948f2557132c25cead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:28.102084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.102497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.103488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.105537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1024/2055] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:27 2022] DELETE /identity/v3/projects/ccb46b851e4643948f2557132c25cead => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:28.111534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.111534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.189049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.191784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87307815-2f2c-49ed-af72-565abf10c8db service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.197393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453ccf3-0c1f-4d55-815e-7bcbb1f1d77c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.203705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.204189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1032/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:28.204862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.205356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.205562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.205796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.206171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.206479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.207340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.209419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.229454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:28.231554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.239505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1033/2057] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:28.240233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.241682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.255009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa430-6546-44b5-b71e-a1c97508a808 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.260433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.265681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.265681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.265681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.265681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.265681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.274026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1034/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:28.274808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.276416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.288915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91aca1-7203-4de9-95be-5886f0c3e53f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.294388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.294758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.295038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.295309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] PATH_INFO: `/v3/users/ecd7109c93374a66a866ed86c3d09914` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.296445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd7109c93374a66a866ed86c3d09914)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.298383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.341615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1025/2059] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/projects => generated 369 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:28.341615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.409059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff594-facf-42cd-82ef-a97276e12b49 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.415223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.415856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.416134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.416408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.417054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:28.417357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.419046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.430980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1026/2060] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:28.431744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.442424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e628-4fc6-4726-9edc-7bf1f1e7db6f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.447178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.447795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.449698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.449698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] PATH_INFO: `/v3/projects/ae97625b1dae482684bee961923b0e0f/users/9570707432b0462f863195faa533ff57/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.450389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae97625b1dae482684bee961923b0e0f, user_id=9570707432b0462f863195faa533ff57, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.453013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.464451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1027/2061] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:28 2022] PUT /identity/v3/projects/ae97625b1dae482684bee961923b0e0f/users/9570707432b0462f863195faa533ff57/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:28.465215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.527000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d39be-d1f9-4847-ac79-c00073c40c6e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.531825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.532494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.532773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.532949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.534924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.535537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.640371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd7109c93374a66a866ed86c3d09914'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.642298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd7109c93374a66a866ed86c3d09914'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.652711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1028/2062] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:28.653924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd7109c93374a66a866ed86c3d09914'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.658782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd7109c93374a66a866ed86c3d09914'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.659506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.661799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.673180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6e308c41-7f0b-4406-a57c-6491c9721ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd7109c93374a66a866ed86c3d09914'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:28.689151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964436f-fddc-4e20-a550-06223b537e25 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.694954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.697662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.697662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.697662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.697662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.699682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.761672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1035/2063] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:28 2022] DELETE /identity/v3/users/ecd7109c93374a66a866ed86c3d09914 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:28.765825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.766145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.766422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.776879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:28.797640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] MFA Rules not processed for user `9570707432b0462f863195faa533ff57`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:28.798896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.815154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1029/2064] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:28.815154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.815154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:28.878714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1036/2065] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:28.879649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.903680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179dd1-e477-42e5-b195-8e5db55cff65 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:28.934832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:28.936457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:28.938497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:28.939441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:28.941277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:28.945617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:28.972330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1030/2066] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:28.974905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:28.979237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.006628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e291-4534-4f6e-ae68-6fd21ea0282e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.006897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:29.017903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.018560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.018867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.019142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.019933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.022039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.056971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e6c5b-6d6e-4058-9920-91d32e860550 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.060784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.061401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.061683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.061978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.063762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.121016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:28 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:29.121920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.132748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e29ca-56ab-4653-b7fd-cc88aa4dac8b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.139097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.139262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.139433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.139788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.140892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.142686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.154060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.157905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1038/2068] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:29.157905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.159945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.169870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6687aea-bb58-42c7-b80f-07bac031327b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.174912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1031/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:29.175058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.175709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.177543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.177701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.177832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.177832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.179425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.194301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a7f42-4e23-48ee-ad41-b7e0cc80790d service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.201609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1039/2070] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:29.202909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.203583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.203863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.204144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] PATH_INFO: `/v3/projects/a953011c91fe401b80f234988dd3f67b/users/443fc38b48a7412e9c748a2f850dba8a/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.205447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.226153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a953011c91fe401b80f234988dd3f67b, user_id=443fc38b48a7412e9c748a2f850dba8a, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.226658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8b7f0-382f-4837-a64a-8d3e5903cad6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.229421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9408645-25a7-47ca-8137-5cf57fc05207 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.232621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.233365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.233753 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.234516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.235432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.237353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.251502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1040/2071] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:29.255904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.268040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6efc4-30bb-49c5-b59a-ad0fd7fa855c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.275338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.276426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.276805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.283170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] PATH_INFO: `/v3/projects/0a94b800a583425da5140939f049e3a5/users/9e05e495be054a97ab84c54fcd6f26b8/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.293644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a94b800a583425da5140939f049e3a5, user_id=9e05e495be054a97ab84c54fcd6f26b8, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.296487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.347836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1032/2072] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:29 2022] PUT /identity/v3/projects/a953011c91fe401b80f234988dd3f67b/users/443fc38b48a7412e9c748a2f850dba8a/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:29.353765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f5c3-7982-4448-8935-07d77f4d4a60 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.354151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f5c3-7982-4448-8935-07d77f4d4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.354472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685f5c3-7982-4448-8935-07d77f4d4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.374687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2685f5c3-7982-4448-8935-07d77f4d4a60 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:29.376000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2685f5c3-7982-4448-8935-07d77f4d4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.395293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1041/2073] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:29 2022] PUT /identity/v3/projects/0a94b800a583425da5140939f049e3a5/users/9e05e495be054a97ab84c54fcd6f26b8/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:29.400653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.406010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.473079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1033/2074] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:29.474605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.474754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5510-06cf-4495-8440-b73bbfce7c9c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.475017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.475367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.481202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.481958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.482348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.482839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] PATH_INFO: `/v3/projects/1779935778bd4d6397f6f2899649d04e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.483989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1779935778bd4d6397f6f2899649d04e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.488821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.510489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] MFA Rules not processed for user `9e05e495be054a97ab84c54fcd6f26b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:29.515030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.582820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1034/2075] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:29.583846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.585134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.645568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743913a-c5c1-4dfc-8c19-b2f056f18a5a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.648061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1779935778bd4d6397f6f2899649d04e', 'request_id': 'req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:29.716203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.717029 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.717462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.717877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.735948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1779935778bd4d6397f6f2899649d04e', 'request_id': 'req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:29.748658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1779935778bd4d6397f6f2899649d04e', 'request_id': 'req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:29.774526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] The token cache is being invalidate because project 1779935778bd4d6397f6f2899649d04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:29.774935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:29.780506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:29.783860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1042/2076] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:29 2022] DELETE /identity/v3/projects/1779935778bd4d6397f6f2899649d04e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:29.784680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:29.791546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.868331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.868331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f80f15-2ba0-4e83-9a38-67fafae6d028 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.885041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1035/2077] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:29.886711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e16d2-b7df-43cd-a5ae-4f66c3ad1824 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.887301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e16d2-b7df-43cd-a5ae-4f66c3ad1824 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.887581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e16d2-b7df-43cd-a5ae-4f66c3ad1824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.912764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c8ca-0d9a-473e-b9d1-e4002c8672c6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:29.915162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-193e16d2-b7df-43cd-a5ae-4f66c3ad1824 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:29.916790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-193e16d2-b7df-43cd-a5ae-4f66c3ad1824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:29.919686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:29.920362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.920649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.920921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.921721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:29.924215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25b92-b669-48c9-a604-88e13724fc74 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:29.927214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1036/2078] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:29.928470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:29.928741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:29.929017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:29.968392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] MFA Rules not processed for user `b02ac305a83e4c58a3b12c739b64e237`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:29.969633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:30.072726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1043/2079] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:29 2022] POST /identity/v3/projects => generated 401 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:30.074219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.075745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.075745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.078780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1037/2080] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:30.080733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.101184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc23ec9-0976-4c4e-8dfe-4bbb3226eb5b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.106042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:30.106224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:30.185632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.185632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.185632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.185632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.186081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.186081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.198503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1044/2081] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:30.199377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.200662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:30.258087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d5c7e-b111-4fbd-bb63-06c82758edf1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.261801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.262428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.262709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.262981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.298003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1038/2082] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:30 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:30.299598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.310737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:30.318790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e83d-f03b-43fe-8c31-8e503cd8d329 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.329217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.329834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.330144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.330424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.331298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:30.331508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.333112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.346210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.349347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.356296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1039/2083] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:30.357413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.362901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1045/2084] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:30.364339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.372911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b40446-ac07-4538-8137-4e85f05fcc28 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.381600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f759539-09be-4b3e-9601-e7e0702bc4b4 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.381727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.382380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.382785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.383038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.384552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.386584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.387163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.387445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.387555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.387734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.388354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.390451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.411270 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1040/2085] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:30.418375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.423179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c54b-c4a5-444b-bfde-ed72805272cc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.427887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.428523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.428805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.429179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] PATH_INFO: `/v3/projects/71c04f1939e64bee89ae678e856f4226/users/e2cf0922d4ba44038279a6db29d44491/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.443713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c04f1939e64bee89ae678e856f4226, user_id=e2cf0922d4ba44038279a6db29d44491, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.446512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.517776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1046/2086] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:30 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:30.518825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.536645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1041/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:30 2022] PUT /identity/v3/projects/71c04f1939e64bee89ae678e856f4226/users/e2cf0922d4ba44038279a6db29d44491/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:30.540689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.587601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add575-51f0-474d-9c9e-22a99273af6a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.622782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d9eae-51a6-4f9e-b775-68edde445f43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.628885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.629521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.629836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.630150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.631357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.633129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.645858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1042/2088] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:30.650659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.658114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.658788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.659072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.659341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.660073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.660723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6853f9-168d-4b45-b4ea-248409319baf admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.662176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.665437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.666130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.666623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.667043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] PATH_INFO: `/v3/projects/71c04f1939e64bee89ae678e856f4226/users/e2cf0922d4ba44038279a6db29d44491/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.670802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c04f1939e64bee89ae678e856f4226, user_id=e2cf0922d4ba44038279a6db29d44491, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.675857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2b526-4fd5-4f48-bc63-c32bb101c304 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.687251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1043/2089] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:30 2022] PUT /identity/v3/projects/71c04f1939e64bee89ae678e856f4226/users/e2cf0922d4ba44038279a6db29d44491/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:30.699232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.699567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.699916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.730907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] MFA Rules not processed for user `e2cf0922d4ba44038279a6db29d44491`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:30.732122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:30.767071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1047/2090] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:30 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:30.771287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.784828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee6df-14b1-4ab9-a1c2-7326882d1778 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.803830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1044/2091] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:30.814721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.816585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:30.845900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.846552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.846924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.847255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.847918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.849689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.860251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1048/2092] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:30.863954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.874679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622f31-ec31-454e-a2ed-7d70f72e3fcb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.879648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.880252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.881843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.881843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.881843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.884296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.890476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecf796-72cb-4334-b53f-6ad110d32ad6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.895172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.895914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.896326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.896733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.898411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1049/2093] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:30.899325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:30.908326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.909516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8ea48-3921-4fb2-b15a-8e0194dc80bd admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:30.910299 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b6867-f7fd-43c0-926f-5727076ac420 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.914875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:30.915544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:30.915829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:30.916108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] PATH_INFO: `/v3/projects/481e65d851cc47fe90d67b285ef18acc/users/d3956578a43c43b7b9ff62faf4383882/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:30.933329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=481e65d851cc47fe90d67b285ef18acc, user_id=d3956578a43c43b7b9ff62faf4383882, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:30.936203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:30.940070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1045/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:31.040811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1050/2095] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:30 2022] PUT /identity/v3/projects/481e65d851cc47fe90d67b285ef18acc/users/d3956578a43c43b7b9ff62faf4383882/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:31.051093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.051565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.051994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.106457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] MFA Rules not processed for user `d3956578a43c43b7b9ff62faf4383882`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:31.107741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:31.119976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:31.238358 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.244964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1046/2096] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:31.254993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.331410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437881b2-0189-4195-b710-e3f301b1fc2a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.342444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.343071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.343894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.343894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.345524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:31.368484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece412f-afb6-448e-8bab-afc5a6480cb9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.373708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.374347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.374630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.374905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.375530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.377448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a756d-a059-4f4d-8041-2054fa2c4ccb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:31.406293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.407860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:31.417363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1051/2097] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:31.525319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1047/2098] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:31 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:31.529901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.540788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddf514-bd10-4e48-a954-cd1252a9346f service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.607681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.608296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.608601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.608927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.609588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.611623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:31.633137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:31.693226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.693516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.693790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.733759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] MFA Rules not processed for user `443fc38b48a7412e9c748a2f850dba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:31.733971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1052/2099] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:31 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:31.735965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:31.737791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.751494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547c221-dbe6-49c1-ac9b-8110a5f4064b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.763244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.763768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.764052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.764327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.764993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.766673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:31.778841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1053/2100] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:31.782846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.801311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89c6b-12f1-41d4-a339-52856ab45ffb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.809972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.810269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.810553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.810833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] PATH_INFO: `/v3/projects/7bfab877edf2406280493600381fd45a/users/26e5ecc20ff2437bbd5a797cde1567bf/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.831930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfab877edf2406280493600381fd45a, user_id=26e5ecc20ff2437bbd5a797cde1567bf, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.834642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:31.851344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1048/2101] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:31.852343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.906989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08cbf-c202-46b7-8bb9-abb1f0bb5c99 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.907278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1054/2102] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:31 2022] PUT /identity/v3/projects/7bfab877edf2406280493600381fd45a/users/26e5ecc20ff2437bbd5a797cde1567bf/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:31.911077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:31.912752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:31.963852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.964381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.964702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.964943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.966729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:31.979466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700295-bbcf-444e-8ca5-a86def20a9d3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:31.984177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:31.984898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:31.985179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:31.985447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:31.986178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:31.988124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.030643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.032167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.042632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1049/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:32.043518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.056241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b39d-0cf3-40b2-ba83-b6ca8499c331 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.056527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1055/2104] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:31 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:32.057454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.123989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b2e52-4767-4a6a-9a1d-3e54f8455a23 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.137672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.139213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.149246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.149246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.149246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.149246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.150785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.151273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.151273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.151640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.152356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.154085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.171243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1050/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:32.181016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.192125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c43594-25c6-4ba4-9b27-75053a7558ca admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.197189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.197842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.198219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.198637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] PATH_INFO: `/v3/projects/7bfab877edf2406280493600381fd45a/users/26e5ecc20ff2437bbd5a797cde1567bf/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.200554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfab877edf2406280493600381fd45a, user_id=26e5ecc20ff2437bbd5a797cde1567bf, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.203256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954289a1-520b-4062-8b96-5492279c468c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.217066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1051/2106] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:32 2022] PUT /identity/v3/projects/7bfab877edf2406280493600381fd45a/users/26e5ecc20ff2437bbd5a797cde1567bf/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:32.217066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac51-d08b-434a-9e0c-f560cc1cd68a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.217066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac51-d08b-434a-9e0c-f560cc1cd68a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.217066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedac51-d08b-434a-9e0c-f560cc1cd68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.235698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ffedac51-d08b-434a-9e0c-f560cc1cd68a None None] MFA Rules not processed for user `b02ac305a83e4c58a3b12c739b64e237`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:32.236909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ffedac51-d08b-434a-9e0c-f560cc1cd68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:32.294441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1052/2107] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:32.295776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.296124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.296460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.326851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] MFA Rules not processed for user `26e5ecc20ff2437bbd5a797cde1567bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:32.328118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:32.373700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1056/2108] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:32 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:32.377526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.388923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477e00d-3837-4c47-a61e-6754f0fb3c3a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.437723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1053/2109] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:32.449308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.454867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.455486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.455766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.456037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.456697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.458525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.473176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1057/2110] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:32.474548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.492196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a436e7-3c23-4a14-b839-4d114c099676 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.497917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.498612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.498956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.499235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] PATH_INFO: `/v3/projects/a00358b9cc5e4e1487edc1fe5da99790/users/3f68cc6e75cb4624bb5c69c8cd048619/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.514653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:32.519319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00358b9cc5e4e1487edc1fe5da99790, user_id=3f68cc6e75cb4624bb5c69c8cd048619, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.522121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.530742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fb15-9865-4b36-b7a3-f355a5ba01fb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.535402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.536265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.536685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.537060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.600069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.603039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.610098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1058/2111] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:32 2022] PUT /identity/v3/projects/a00358b9cc5e4e1487edc1fe5da99790/users/3f68cc6e75cb4624bb5c69c8cd048619/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:32.611475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.612516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1054/2112] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:32.679477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:32.704825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6196973-e0fe-42ec-bf80-66c101f6dae9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.713420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.714577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.714577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.714769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.715334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.716996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.728531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1059/2113] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:32.732779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:32.747115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb3af-dd1f-4a25-9867-0ae396a95fc7 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:32.754611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:32.755347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:32.755775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:32.756049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] PATH_INFO: `/v3/projects/a00358b9cc5e4e1487edc1fe5da99790/users/3f68cc6e75cb4624bb5c69c8cd048619/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:32.758068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00358b9cc5e4e1487edc1fe5da99790, user_id=3f68cc6e75cb4624bb5c69c8cd048619, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:32.761409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6816-b0d7-4f77-adc0-44ff2a312948 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:32.772328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1055/2114] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:32 2022] PUT /identity/v3/projects/a00358b9cc5e4e1487edc1fe5da99790/users/3f68cc6e75cb4624bb5c69c8cd048619/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:34.474627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:34.608884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:34.668101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086885-b553-46f3-a415-839f817f1e0a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:34.727859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:34.728477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:34.728756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:34.729028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:34.730865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:34.794148 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:34.795602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c1a95-3110-4b4d-b552-a971c22ea60e service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:34.805154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1060/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:34.912245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:34.990081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:34.990529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:34.991521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:35.066478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] MFA Rules not processed for user `3f68cc6e75cb4624bb5c69c8cd048619`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:35.067896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:35.217991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1056/2116] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:35.221537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:35.221881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:35.222209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:35.242194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] MFA Rules not processed for user `443fc38b48a7412e9c748a2f850dba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:35.243443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:35.303940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1061/2117] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:35.315446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:35.325449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:35.428173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c21eb1-881f-4190-a553-e5a91a54117f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:35.433054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:35.433679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:35.433979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:35.434259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:35.444608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:35.447503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:35.461219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1057/2118] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:35.886309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:35.951796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:35.962379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e0b7f-3d51-4751-ab5f-6f520f3d4b39 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:35.967422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:35.968034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:35.968313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:35.968587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:36.063199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:36.067818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e95a50-d158-41ca-99c6-37110a59979e service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:36.083578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1062/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:37.397839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:38.040980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:38.125893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a63d-fb03-44bc-b1d2-e4ae1895b3db service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:38.135388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:38.136327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:38.136771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:38.137262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] PATH_INFO: `/v3/users/9e05e495be054a97ab84c54fcd6f26b8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:38.138658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e05e495be054a97ab84c54fcd6f26b8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:38.152099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:38.367247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e05e495be054a97ab84c54fcd6f26b8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:38.378109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e05e495be054a97ab84c54fcd6f26b8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:38.379113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e05e495be054a97ab84c54fcd6f26b8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:38.379907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e05e495be054a97ab84c54fcd6f26b8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:38.489549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e05e495be054a97ab84c54fcd6f26b8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:38.495570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:38.527069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1058/2120] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:38 2022] DELETE /identity/v3/users/9e05e495be054a97ab84c54fcd6f26b8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:38.531843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:38.532364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:38.535516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:38.592563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:38.593784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:38.662320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1063/2121] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:38.690182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:38.693994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:38.755100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b9499-b492-4092-8c27-fdf665785161 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:38.759507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:38.760182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:38.760534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:38.760815 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:38.770054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:38.771498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:38.784103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1059/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:38.999870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:39.003393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:39.037811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792dfb8-b1f6-4d9b-a5a7-6faffca189e7 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:39.058718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:39.059527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:39.059915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:39.060305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] PATH_INFO: `/v3/users/14e8865cb1b84e4b89978ba735ec2037` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:39.061650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e8865cb1b84e4b89978ba735ec2037)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:39.063885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:39.320539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e8865cb1b84e4b89978ba735ec2037'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:39.321562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e8865cb1b84e4b89978ba735ec2037'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:39.331460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e8865cb1b84e4b89978ba735ec2037'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:39.332781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e8865cb1b84e4b89978ba735ec2037'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:39.346930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e8865cb1b84e4b89978ba735ec2037'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:39.485724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1064/2123] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:38 2022] DELETE /identity/v3/users/14e8865cb1b84e4b89978ba735ec2037 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:39.723414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:39.726766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:39.748219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3871-ae7e-4889-8ad7-ca26ef07179a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:39.851891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:39.861726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:39.861726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:39.861726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:39.861726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] PATH_INFO: `/v3/projects/0a94b800a583425da5140939f049e3a5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:39.862242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a94b800a583425da5140939f049e3a5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:39.866638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:39.927432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:39.931135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:39.944045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a6989-4005-451f-ba2e-454a45ce9811 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:39.949413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:39.950088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:39.950396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:39.950649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] PATH_INFO: `/v3/projects/0ebb2fce94ed44dbb9c625d48e6b781c` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:39.952247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebb2fce94ed44dbb9c625d48e6b781c)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:39.954240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.023183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a94b800a583425da5140939f049e3a5', 'request_id': 'req-334bb039-1aa3-495b-b09b-dfc190e1841b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.028917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a94b800a583425da5140939f049e3a5', 'request_id': 'req-334bb039-1aa3-495b-b09b-dfc190e1841b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.035301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a94b800a583425da5140939f049e3a5', 'request_id': 'req-334bb039-1aa3-495b-b09b-dfc190e1841b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.114405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebb2fce94ed44dbb9c625d48e6b781c', 'request_id': 'req-24beb2ab-2b17-4462-8e63-a8dbb00505f2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.165432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] The token cache is being invalidate because project 0a94b800a583425da5140939f049e3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:40.169876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.169876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.169876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1060/2124] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:39 2022] DELETE /identity/v3/projects/0a94b800a583425da5140939f049e3a5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:40.172936 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.174863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:40.239324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bb039-1aa3-495b-b09b-dfc190e1841b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.250840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebb2fce94ed44dbb9c625d48e6b781c', 'request_id': 'req-24beb2ab-2b17-4462-8e63-a8dbb00505f2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.258570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebb2fce94ed44dbb9c625d48e6b781c', 'request_id': 'req-24beb2ab-2b17-4462-8e63-a8dbb00505f2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.272169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] The token cache is being invalidate because project 0ebb2fce94ed44dbb9c625d48e6b781c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:40.272685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.273575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-24beb2ab-2b17-4462-8e63-a8dbb00505f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.279945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1065/2125] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:39 2022] DELETE /identity/v3/projects/0ebb2fce94ed44dbb9c625d48e6b781c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:40.283530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b5f-f85e-4275-b2a5-1441a25c2ad0 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.283530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b5f-f85e-4275-b2a5-1441a25c2ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.283530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0b5f-f85e-4275-b2a5-1441a25c2ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.307501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-338f0b5f-f85e-4275-b2a5-1441a25c2ad0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:40.309083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-338f0b5f-f85e-4275-b2a5-1441a25c2ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:40.310924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.311673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.312169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.312640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] PATH_INFO: `/v3/users/e2cf0922d4ba44038279a6db29d44491` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.314252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cf0922d4ba44038279a6db29d44491)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.317479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1066/2126] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:40.318902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.326539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.326995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.327420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.349692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:40.351402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:40.361715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1067/2127] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:40.366108 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.376089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eefc28-b7ed-40ad-b963-0a58698e34a1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.380867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.381476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.381756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.382062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.382721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:40.383026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.384671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.396767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1068/2128] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:40.402501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.417496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b6b0-5ae0-4bde-b825-aa95c0250081 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.423218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.423996 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.424283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.424608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.425288 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.428853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.533442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1069/2129] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:40 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:40.535079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.557805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cf0922d4ba44038279a6db29d44491'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.564677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cf0922d4ba44038279a6db29d44491'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.565356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cf0922d4ba44038279a6db29d44491'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.565985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cf0922d4ba44038279a6db29d44491'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.613959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea0c-d711-44ef-bb48-155455bdab1a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.620456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.621110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.621439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.621716 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.622443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.624492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.666644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cf0922d4ba44038279a6db29d44491'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:40.693642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1061/2130] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:40 2022] DELETE /identity/v3/users/e2cf0922d4ba44038279a6db29d44491 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:40.704424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1070/2131] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:40 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:40.711202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.713126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:40.759279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:40.781237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ca455-539e-42cc-a239-f403598fb79f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.785828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.786469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.786748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.787038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.787894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.789558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.799510 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1062/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:40.803608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.814483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180852b6-d50d-4949-a038-0e34c943060b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.819140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.819735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.820016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.820389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.821066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.822806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ddef1-71ac-43f4-af2e-5c8de02c1bad admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.832823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1071/2133] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:40.837532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:40.847487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0513e-5ea0-45f7-b083-98336ce1fa1a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:40.853133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:40.853772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.854098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.854421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] PATH_INFO: `/v3/projects/5c1bd55566534103b783e657c2191792/users/8a3020f93df64f2aab880322ef0c4c30/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:40.868834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1bd55566534103b783e657c2191792, user_id=8a3020f93df64f2aab880322ef0c4c30, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:40.871817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:40.980967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1063/2134] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:40 2022] PUT /identity/v3/projects/5c1bd55566534103b783e657c2191792/users/8a3020f93df64f2aab880322ef0c4c30/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:40.983246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:40.983924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:40.983924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.014865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:41.016200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.101488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1072/2135] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:41.110337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.114298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.173577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6f5d7-92c5-45af-98de-9a83162cdcbd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.177433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.178072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.178367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.178689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.188283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.189722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1952a5-2905-44d4-80a0-8bafa255a559 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.200548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1064/2136] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:41.222766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.224466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.239879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab806d-ac64-49ee-b29c-ca9f28238b81 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.246062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.246704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.247391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.247391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] PATH_INFO: `/v3/projects/71c04f1939e64bee89ae678e856f4226` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.248450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c04f1939e64bee89ae678e856f4226)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.250399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.269705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:41.406567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c04f1939e64bee89ae678e856f4226', 'request_id': 'req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.513001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c04f1939e64bee89ae678e856f4226', 'request_id': 'req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.523046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c04f1939e64bee89ae678e856f4226', 'request_id': 'req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.534641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] The token cache is being invalidate because project 71c04f1939e64bee89ae678e856f4226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:41.535000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.535963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.537609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1073/2137] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:41 2022] DELETE /identity/v3/projects/71c04f1939e64bee89ae678e856f4226 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:41.549921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497595cd-a9f9-4131-af7e-f3d165ae16f3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.549921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497595cd-a9f9-4131-af7e-f3d165ae16f3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.549921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497595cd-a9f9-4131-af7e-f3d165ae16f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.577188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-497595cd-a9f9-4131-af7e-f3d165ae16f3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:41.577188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-497595cd-a9f9-4131-af7e-f3d165ae16f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.578518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.583890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.652735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1065/2138] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:41.661090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.661458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.661816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.684949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8cad-c01c-4f9c-ac3c-12c3f64f5a2a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.688927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:41.690388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:41.695687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.697675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.697879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.698847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] PATH_INFO: `/v3/users/baccb60a6e2041f6934db1a0ef931a55` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.702697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=baccb60a6e2041f6934db1a0ef931a55)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.704972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.708520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1066/2139] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:41.709411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.720628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521215c-0e7d-4569-9984-e5cfc5f7cfa3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.726148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.726763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.727104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.727389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.728081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:41.728388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.730169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.750396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1067/2140] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:41.751580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.762672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820a794-0851-4de4-bdb7-f3cd631d162a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.769920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.770653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.770824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.771184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.771713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.782095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.899596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1068/2141] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:41 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:41.903532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:41.965560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18bcc-d238-44be-8903-98e9a053b219 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:41.970786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:41.971531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:41.972129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:41.972513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:41.973309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:41.973470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baccb60a6e2041f6934db1a0ef931a55'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.974037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baccb60a6e2041f6934db1a0ef931a55'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.975574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:41.982577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baccb60a6e2041f6934db1a0ef931a55'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.983262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baccb60a6e2041f6934db1a0ef931a55'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:41.996794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-13dab952-3cf0-45fc-9924-75720060a8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baccb60a6e2041f6934db1a0ef931a55'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.096750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1074/2142] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:41 2022] DELETE /identity/v3/users/baccb60a6e2041f6934db1a0ef931a55 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:42.099983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1069/2143] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:41 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:42.103072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571639-7762-4db8-8c69-779f620fae7b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.103461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571639-7762-4db8-8c69-779f620fae7b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.103803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58571639-7762-4db8-8c69-779f620fae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.104483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.106352 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.124174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-58571639-7762-4db8-8c69-779f620fae7b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:42.125477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-58571639-7762-4db8-8c69-779f620fae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.126887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f359552-2950-47dd-9abe-d206d72814e2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.187817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.188447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1075/2144] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:42.188568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.188786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.189122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58571639-7762-4db8-8c69-779f620fae7b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.189227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.189833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.190448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-58571639-7762-4db8-8c69-779f620fae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.191583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.203457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58571639-7762-4db8-8c69-779f620fae7b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.208756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1070/2145] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:42.208756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.209991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.211235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.212599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.212952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.213400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] PATH_INFO: `/v3/users/d3956578a43c43b7b9ff62faf4383882` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.215012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3956578a43c43b7b9ff62faf4383882)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.218759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.272760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768080-abea-44de-aa93-f87fdc97116b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.282063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.283171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.283501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.283784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.294479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.295993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.307118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1071/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:42.307967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.321676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f28ae-2790-4b26-9c7c-fd493990058b service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.327320 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.327889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.328166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.328667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.329186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.330792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.343313 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1072/2147] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:42.346095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.356532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e5ef-90af-4b5b-ba4c-9e925cc584fe admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.361185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.361830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.362144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.362658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] PATH_INFO: `/v3/projects/3a47723e17434995894d3f0d37299c46/users/561bf51d47f34f7cb90fc642e6aeeda2/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.377734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a47723e17434995894d3f0d37299c46, user_id=561bf51d47f34f7cb90fc642e6aeeda2, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.380470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86209e7e-c641-4281-8028-3c3c072f4fbe admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.396694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3956578a43c43b7b9ff62faf4383882'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.397490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3956578a43c43b7b9ff62faf4383882'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.406919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3956578a43c43b7b9ff62faf4383882'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.410168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3956578a43c43b7b9ff62faf4383882'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.420244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-acae410d-9a09-45b5-9145-3177e28f847a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3956578a43c43b7b9ff62faf4383882'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:42.445257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1073/2148] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:42 2022] PUT /identity/v3/projects/3a47723e17434995894d3f0d37299c46/users/561bf51d47f34f7cb90fc642e6aeeda2/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:42.456139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.456429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.456706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.484243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] MFA Rules not processed for user `561bf51d47f34f7cb90fc642e6aeeda2`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:42.485448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.526755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1076/2149] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:42 2022] DELETE /identity/v3/users/d3956578a43c43b7b9ff62faf4383882 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:42.535466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.535764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.536609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.576052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:42.577296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.581658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1074/2150] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:42.586120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.590646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.658216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1077/2151] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:42.668589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.671866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bddd8-13d9-49a4-99f6-c792710362dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.673676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.684742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.685360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.685636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.685905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.686576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.688516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.701369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:42.748759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c246e-7ccf-4063-bddf-50ba6954a13f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.752465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.753066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.753352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.753624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.762732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.764182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:42.774312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1078/2152] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:42.830334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1075/2153] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:42 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:47:42.831504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.845686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:42.849424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:42.865051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91226887-1abc-4440-8e71-82cda560bff0 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.960141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5dac8-325c-4acb-9bb9-d39bee43ba07 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:42.966818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:42.967753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:42.968114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:42.968467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] PATH_INFO: `/v3/projects/ae0f3abd99a24a538fa5e7657d1a0462` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:42.970222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0f3abd99a24a538fa5e7657d1a0462)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:42.973679 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.022651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.023482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.023768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.024046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.025876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.028099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.152780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0f3abd99a24a538fa5e7657d1a0462', 'request_id': 'req-5b17537d-0f44-474f-a6a0-d419c286cfef'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.168143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0f3abd99a24a538fa5e7657d1a0462', 'request_id': 'req-5b17537d-0f44-474f-a6a0-d419c286cfef'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.179616 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0f3abd99a24a538fa5e7657d1a0462', 'request_id': 'req-5b17537d-0f44-474f-a6a0-d419c286cfef'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.189538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1079/2154] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:42 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:43.193703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.222417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbad79-11cb-4ff0-8c39-b9946ba8d354 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.281772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] The token cache is being invalidate because project ae0f3abd99a24a538fa5e7657d1a0462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:43.282572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.283765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.286301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1076/2155] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:42 2022] DELETE /identity/v3/projects/ae0f3abd99a24a538fa5e7657d1a0462 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:43.289896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.293800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.298832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:43.305190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.306775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.307054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.307520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.308413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.311928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.313115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17537d-0f44-474f-a6a0-d419c286cfef admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.320843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.321816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.323750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.324045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] PATH_INFO: `/v3/users/afd970e489a54880a8eb65810e666f02` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.325378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd970e489a54880a8eb65810e666f02)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.327503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.331957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1080/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:43.335686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.344040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.392005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65944c8-abf8-4891-9f11-d326e23e9430 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.406489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.407231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.407563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.407901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] PATH_INFO: `/v3/projects/f007ed00c1ac43108491e58ee510cea8/users/a90f675f570d48fe9a8c494347b46fef/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.427547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f007ed00c1ac43108491e58ee510cea8, user_id=a90f675f570d48fe9a8c494347b46fef, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.430338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.585101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1081/2157] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:43 2022] PUT /identity/v3/projects/f007ed00c1ac43108491e58ee510cea8/users/a90f675f570d48fe9a8c494347b46fef/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:43.588009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.648431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd970e489a54880a8eb65810e666f02'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.670782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd970e489a54880a8eb65810e666f02'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.679366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd970e489a54880a8eb65810e666f02'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.680275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd970e489a54880a8eb65810e666f02'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.749403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27421-5c99-4664-84bc-0172e82bba68 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.753590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd970e489a54880a8eb65810e666f02'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:43.764064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.765511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.765815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.766124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.766785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.768891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.775365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1077/2158] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:43 2022] DELETE /identity/v3/users/afd970e489a54880a8eb65810e666f02 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:43.796544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1082/2159] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:43.800516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.806307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.857892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.861504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.891250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638d32e-6e3b-4c94-8073-5c2959561c3e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.904739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.905593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.905830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.906247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] PATH_INFO: `/v3/projects/481e65d851cc47fe90d67b285ef18acc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.910619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] RBAC: Authorizing `identity:delete_project(project_id=481e65d851cc47fe90d67b285ef18acc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.913012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.926382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebd671-e695-465e-a59a-8269d3c367f1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.931248 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.932489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.932489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.932711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] PATH_INFO: `/v3/projects/f007ed00c1ac43108491e58ee510cea8/users/a90f675f570d48fe9a8c494347b46fef/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.936103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f007ed00c1ac43108491e58ee510cea8, user_id=a90f675f570d48fe9a8c494347b46fef, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.940262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752434fa-4974-4835-a08c-3617bffabae5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.966023 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1078/2160] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:43 2022] PUT /identity/v3/projects/f007ed00c1ac43108491e58ee510cea8/users/a90f675f570d48fe9a8c494347b46fef/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:43.969473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.970553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.972511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.023934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] MFA Rules not processed for user `a90f675f570d48fe9a8c494347b46fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.026435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.111213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481e65d851cc47fe90d67b285ef18acc', 'request_id': 'req-bc9353fb-1c52-42dc-9f88-de4b8d07319f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.177851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1079/2161] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.189176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.191743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.214250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481e65d851cc47fe90d67b285ef18acc', 'request_id': 'req-bc9353fb-1c52-42dc-9f88-de4b8d07319f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.233582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481e65d851cc47fe90d67b285ef18acc', 'request_id': 'req-bc9353fb-1c52-42dc-9f88-de4b8d07319f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.267793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] The token cache is being invalidate because project 481e65d851cc47fe90d67b285ef18acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:44.268014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.270313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.276245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1083/2162] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:43 2022] DELETE /identity/v3/projects/481e65d851cc47fe90d67b285ef18acc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:44.286184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.291261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.315943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:44.341139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c6a97-49fd-4390-9db6-5966e525725b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.459341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.460291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.460769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.461489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.463812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.470801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9353fb-1c52-42dc-9f88-de4b8d07319f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.483899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.484984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.484984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.485259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] PATH_INFO: `/v3/users/26e5ecc20ff2437bbd5a797cde1567bf` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.490910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e5ecc20ff2437bbd5a797cde1567bf)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.493857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.502684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:44.577279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.582678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.598579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1080/2163] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:44.713202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.715038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.741746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d8d7-d055-4771-8ced-07531147a114 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.767240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.772790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.772790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.772790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] PATH_INFO: `/v3/projects/0688f0874dd4404f904e2177ea948c49` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.772790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0688f0874dd4404f904e2177ea948c49)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.773703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.794991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e5ecc20ff2437bbd5a797cde1567bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.796586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e5ecc20ff2437bbd5a797cde1567bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.824539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e5ecc20ff2437bbd5a797cde1567bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.824539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e5ecc20ff2437bbd5a797cde1567bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.848630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e5ecc20ff2437bbd5a797cde1567bf'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.953248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1084/2164] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:44 2022] DELETE /identity/v3/users/26e5ecc20ff2437bbd5a797cde1567bf => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:44.956950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.964198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.975454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0688f0874dd4404f904e2177ea948c49', 'request_id': 'req-919a3d9c-d318-46df-b837-8d7f0933649d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:44.989242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0688f0874dd4404f904e2177ea948c49', 'request_id': 'req-919a3d9c-d318-46df-b837-8d7f0933649d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.001020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0688f0874dd4404f904e2177ea948c49', 'request_id': 'req-919a3d9c-d318-46df-b837-8d7f0933649d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.070448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50a304-b96b-4cc1-a309-50ae45342042 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.072667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.073519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.074601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.074601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.076581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:45.118118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] The token cache is being invalidate because project 0688f0874dd4404f904e2177ea948c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:45.119030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.120016 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.122236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1081/2165] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:44 2022] DELETE /identity/v3/projects/0688f0874dd4404f904e2177ea948c49 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:45.127440 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.129773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:45.168651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.170157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.187246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1085/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:45.311624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.330403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3d9c-d318-46df-b837-8d7f0933649d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.431775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.432419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.432699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.432970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] PATH_INFO: `/v3/users/9570707432b0462f863195faa533ff57` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.434340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9570707432b0462f863195faa533ff57)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.436455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.573191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.575163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:45.590956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc77d2-b1a7-46e1-88ea-55c093614309 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.598297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.599230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.600722 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.601224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] PATH_INFO: `/v3/projects/7bfab877edf2406280493600381fd45a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.603461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfab877edf2406280493600381fd45a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.606566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.677447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9570707432b0462f863195faa533ff57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.688652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9570707432b0462f863195faa533ff57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.690479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9570707432b0462f863195faa533ff57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.693920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9570707432b0462f863195faa533ff57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.755666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfab877edf2406280493600381fd45a', 'request_id': 'req-df9be194-8d00-499c-9b0b-783ce2bbf66c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.765810 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-0bc2d40d-0ea1-4341-8c5f-2719d05005e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9570707432b0462f863195faa533ff57'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.798493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1082/2167] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:45 2022] DELETE /identity/v3/users/9570707432b0462f863195faa533ff57 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:45.799964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.867917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfab877edf2406280493600381fd45a', 'request_id': 'req-df9be194-8d00-499c-9b0b-783ce2bbf66c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.876060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfab877edf2406280493600381fd45a', 'request_id': 'req-df9be194-8d00-499c-9b0b-783ce2bbf66c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.888874 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] The token cache is being invalidate because project 7bfab877edf2406280493600381fd45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:45.889177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.890298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df9be194-8d00-499c-9b0b-783ce2bbf66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:45.892646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1086/2168] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:45 2022] DELETE /identity/v3/projects/7bfab877edf2406280493600381fd45a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:45.897777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.898105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.898368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.920409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:45.921642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.023531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.023818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.024096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.026869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1083/2169] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.064463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:46.065969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.080932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.091926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ef602-e0a2-4161-89dd-bdaf2dc9b152 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.092162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1087/2170] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.098200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.099620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.099620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.099820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.100587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:46.100907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.102948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.116441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1084/2171] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:46.122226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.134083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972136bc-c54d-4506-b503-f9945c762c69 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.139440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.140262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.140596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.141023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.141877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.144683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.267970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1088/2172] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.269135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.279562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bcf90-79fd-4b6c-8800-9a7107f2db83 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.362764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.363727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.363897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.364317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.364974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.367032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.516171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1085/2173] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.520821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.533158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaded622-0c67-435a-b31f-2cc02cf7e241 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.539670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.540672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.541678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.542258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.543107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.545032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.560444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1089/2174] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.561396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.573314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55acdc-ab92-4870-8b5a-582f4b7731ab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.579893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.580906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.581535 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.581893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.582600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.584747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.597980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1086/2175] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:46.602702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.613575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d4045-bb96-4925-b867-2091155858b1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.620855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.621839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.622489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.622938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] PATH_INFO: `/v3/projects/fc39c52698cc48c48b443aae202fa0dc/users/46614e576aba4f89a9ffd97b57c6612d/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.643266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc39c52698cc48c48b443aae202fa0dc, user_id=46614e576aba4f89a9ffd97b57c6612d, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.646261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec1fd-c1b3-4f8d-8543-ad6f83cf8880 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.737133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.738990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1090/2176] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/fc39c52698cc48c48b443aae202fa0dc/users/46614e576aba4f89a9ffd97b57c6612d/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:46.740148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.751733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.752178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.752779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.768685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71fc6c-29cc-4e07-82cd-20b0d7d0ffd0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.793402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] MFA Rules not processed for user `46614e576aba4f89a9ffd97b57c6612d`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:46.794809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.846115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.846675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.846957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.847278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] PATH_INFO: `/v3/projects/ae97625b1dae482684bee961923b0e0f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.848375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae97625b1dae482684bee961923b0e0f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.850400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.890600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1091/2177] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.896738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.912128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dd87-cb70-46d8-a66b-abd02c4cd34d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.922129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.922918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.923299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.923636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.924337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.927089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.965606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae97625b1dae482684bee961923b0e0f', 'request_id': 'req-6f6341a6-e043-449a-8752-b8d9bda601dc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:46.973153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae97625b1dae482684bee961923b0e0f', 'request_id': 'req-6f6341a6-e043-449a-8752-b8d9bda601dc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:46.982195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae97625b1dae482684bee961923b0e0f', 'request_id': 'req-6f6341a6-e043-449a-8752-b8d9bda601dc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:47.020734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1092/2178] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.022418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.065865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] The token cache is being invalidate because project ae97625b1dae482684bee961923b0e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:47.066322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:47.067177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6f6341a6-e043-449a-8752-b8d9bda601dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:47.074896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1087/2179] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:46 2022] DELETE /identity/v3/projects/ae97625b1dae482684bee961923b0e0f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:47.076893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cca6-ba71-4ef4-a38e-8f0383cdaa4a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.077268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cca6-ba71-4ef4-a38e-8f0383cdaa4a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.077591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cca6-ba71-4ef4-a38e-8f0383cdaa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.105578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a481cca6-ba71-4ef4-a38e-8f0383cdaa4a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.108170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a481cca6-ba71-4ef4-a38e-8f0383cdaa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.152441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c432f8-7e5f-4564-92c6-a477674d3c03 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.158057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.159005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.159462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.159907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.160812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.163080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.240399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1093/2180] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.245651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.248233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.249882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1088/2181] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.257656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.258201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.258489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.285170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bab56-2f2d-40bc-bd1c-f6da06f0af11 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.291026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.291660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.291940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.292217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.292881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.294710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.299268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.300732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.316975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1089/2182] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:47.320120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.324598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1094/2183] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:47.334786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.336766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62db5f-d03d-4b36-a299-55450e97c1d0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.343519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.344664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.345817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.346419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.347587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:47.348670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.351272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.351995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffec2cf-b4f1-407c-b2b4-241fd38187f0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.371149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.371880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.372232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.372575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.373307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.374907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1090/2184] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:47.375208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.378981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.390496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1095/2185] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:47.395717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.399582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d1c4f-f1a2-4ceb-8098-4254eacb0805 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.408610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.410239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.410239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.410239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.410821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.411376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead1085-47ee-4ddb-8f0e-0c2843819cea admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.413039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.420003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.422136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.422535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.422914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] PATH_INFO: `/v3/projects/1fe130c91fd1469b87f56a6c77bf47bd/users/f68b87fda0e340108667ad97985d9075/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.447402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe130c91fd1469b87f56a6c77bf47bd, user_id=f68b87fda0e340108667ad97985d9075, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.450702 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c752a-2b0a-4f15-b324-6c43b2ad9089 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.537721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1091/2186] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.539511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.556393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1096/2187] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:47 2022] PUT /identity/v3/projects/1fe130c91fd1469b87f56a6c77bf47bd/users/f68b87fda0e340108667ad97985d9075/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:47.567114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.567844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.568365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.610812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] MFA Rules not processed for user `f68b87fda0e340108667ad97985d9075`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.612430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.673243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286515-ccd0-460d-9c55-1b6c255f2fe1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.722272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1097/2188] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.730766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.759792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.759792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.759792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.759792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.760246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.762060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.811212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb3beb-8182-4992-ace2-ead8d50a89e4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.816042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.816657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.817649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.817649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.818000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.820166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.865245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:47.872074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1092/2189] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.880435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.891080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de9e9-88bd-47fc-9a20-5cbcc766e436 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.896963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.897565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.903069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.903069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.903069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.906379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.925982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1098/2190] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.926215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1093/2191] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:47:47.930239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.930460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.941725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89fd9b-28ee-47f9-b5b9-230ff7449164 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.996759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d679d9-8170-4038-b891-6990afee9856 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.998708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.999322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.999655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.005471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.005471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.005651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.005743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.005816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.005816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.005816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.005816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.005816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.015008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1094/2192] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.019014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.030685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c47e0-d1a6-482d-831d-b7d6b5415919 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.036239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.036913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.037189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.037463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] PATH_INFO: `/v3/projects/466770b6707347f380b161b8d2668940/users/e14ae1ae55324c75b93776a386bffa14/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.056650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] RBAC: Authorizing `identity:create_grant(project_id=466770b6707347f380b161b8d2668940, user_id=e14ae1ae55324c75b93776a386bffa14, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.060319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fa1d0-ac0e-40a8-85b0-f62dff4eacec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.105415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1099/2193] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:48.109591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.128220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d403a-14c9-4018-bc16-7023c1f41c21 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.138045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1095/2194] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/466770b6707347f380b161b8d2668940/users/e14ae1ae55324c75b93776a386bffa14/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:47:48.144309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.144935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.145222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.145509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.147499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.150105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.152025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.152311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.152589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.174015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1100/2195] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.178740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.210950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef199893-080e-4bcd-a53c-ea05938ef1ff admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.217450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] MFA Rules not processed for user `e14ae1ae55324c75b93776a386bffa14`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:48.219017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:48.317615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.318563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.319256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.319486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] PATH_INFO: `/v3/projects/36df570ce1e145609a856cf0d3fe3571/users/903e00b3f76a41c694fc9a0615a0bc82/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.338688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36df570ce1e145609a856cf0d3fe3571, user_id=903e00b3f76a41c694fc9a0615a0bc82, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.341970 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.362385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1096/2196] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:48.369310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.371283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:48.454083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eaa59-0409-44ee-9efc-7f6a72205932 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.464838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.465587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.466003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.466386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.479189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.480956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.492254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1097/2197] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:48.502518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1101/2198] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/36df570ce1e145609a856cf0d3fe3571/users/903e00b3f76a41c694fc9a0615a0bc82/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:48.507434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.522400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66684e12-8450-4392-8253-2d15ed70fd22 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.543541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.629019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.629690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.630002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.630315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.630931 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.632613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de21b3f-10a2-4db3-9681-deb9c96d1296 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.652542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.682080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1098/2199] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.686917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe57677-5f7f-4171-926b-03ddf06405c7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.702033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.702943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.703631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.704295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] PATH_INFO: `/v3/projects/36df570ce1e145609a856cf0d3fe3571/users/903e00b3f76a41c694fc9a0615a0bc82/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.708036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36df570ce1e145609a856cf0d3fe3571, user_id=903e00b3f76a41c694fc9a0615a0bc82, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.710946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.738813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1102/2200] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/36df570ce1e145609a856cf0d3fe3571/users/903e00b3f76a41c694fc9a0615a0bc82/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:48.749597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d83a3-9b20-4aa4-b139-1f8f4c84201d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.749894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d83a3-9b20-4aa4-b139-1f8f4c84201d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.750197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d83a3-9b20-4aa4-b139-1f8f4c84201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.799583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-862d83a3-9b20-4aa4-b139-1f8f4c84201d None None] MFA Rules not processed for user `903e00b3f76a41c694fc9a0615a0bc82`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:48.803532 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-862d83a3-9b20-4aa4-b139-1f8f4c84201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:48.930702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1099/2201] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:48.939002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.941645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.012104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fe174-bc76-4e04-b897-1c959f092630 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.017265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.018691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.019038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.019377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.068370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.072291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.090107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1103/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:49.311800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.312272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.312493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.354122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] MFA Rules not processed for user `8a3020f93df64f2aab880322ef0c4c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:49.358159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.509797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1100/2203] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:49.517561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.519972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.658459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879e18d-6b75-4bcf-bdbf-778abf1bb150 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.665402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.666824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.667252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.667679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.678792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.680659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08875b5b-c6e8-49eb-96ca-cc77b37f58c1 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.699289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1104/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:49.785584 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.787368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.867771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c90eb7-0e4b-436b-84bd-ab970155931a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.873174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.873805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.874131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.874402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] PATH_INFO: `/v3/users/561bf51d47f34f7cb90fc642e6aeeda2` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.875545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=561bf51d47f34f7cb90fc642e6aeeda2)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.877450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.148957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561bf51d47f34f7cb90fc642e6aeeda2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:50.156636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561bf51d47f34f7cb90fc642e6aeeda2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:50.157325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561bf51d47f34f7cb90fc642e6aeeda2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:50.158033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561bf51d47f34f7cb90fc642e6aeeda2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:50.251002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561bf51d47f34f7cb90fc642e6aeeda2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:50.269408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1101/2205] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:49 2022] DELETE /identity/v3/users/561bf51d47f34f7cb90fc642e6aeeda2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:50.274042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.274332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.274606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.295226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:50.296443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:50.392105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1105/2206] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:50.403423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.405012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:50.487777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8adf9-68b8-4a00-8f6f-8c2a84ab2a6a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.492200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.492904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.493254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.493669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.508607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.510348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.532409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1102/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:50.697336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.698801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:50.776742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09ebcf-62f0-47e3-bc5a-10831065fd02 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.798123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.799404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.801627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.801949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.818049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:50.906221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.910074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.925836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1106/2208] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:51.117259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:51.120435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:51.185619 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dcd34-8741-44d7-87a4-9fb45b510fef service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:51.193240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:51.193890 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:51.194206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:51.194485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] PATH_INFO: `/v3/projects/3a47723e17434995894d3f0d37299c46` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:51.195702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a47723e17434995894d3f0d37299c46)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:51.199415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:51.368375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a47723e17434995894d3f0d37299c46', 'request_id': 'req-cc95aade-ceaf-4bed-b145-83d859ad6c34'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.378294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a47723e17434995894d3f0d37299c46', 'request_id': 'req-cc95aade-ceaf-4bed-b145-83d859ad6c34'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.388015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a47723e17434995894d3f0d37299c46', 'request_id': 'req-cc95aade-ceaf-4bed-b145-83d859ad6c34'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.525611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] The token cache is being invalidate because project 3a47723e17434995894d3f0d37299c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:51.525611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.525611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cc95aade-ceaf-4bed-b145-83d859ad6c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.525611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1103/2209] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:51 2022] DELETE /identity/v3/projects/3a47723e17434995894d3f0d37299c46 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:51.528665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:51.537478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd730-4300-4623-949c-f7eba6096650 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:51.537987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd730-4300-4623-949c-f7eba6096650 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:51.538370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd730-4300-4623-949c-f7eba6096650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:51.543207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728f36f-8a53-465d-9305-2f051c7296d3 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:51.559483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-573dd730-4300-4623-949c-f7eba6096650 None None] MFA Rules not processed for user `e14ae1ae55324c75b93776a386bffa14`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:51.560708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-573dd730-4300-4623-949c-f7eba6096650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:51.611845 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:51.612489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:51.612834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:51.613177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] PATH_INFO: `/v3/users/a90f675f570d48fe9a8c494347b46fef` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:51.614491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90f675f570d48fe9a8c494347b46fef)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:51.616531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:51.626509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1104/2210] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:51.853674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90f675f570d48fe9a8c494347b46fef'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.855015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90f675f570d48fe9a8c494347b46fef'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.863771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90f675f570d48fe9a8c494347b46fef'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.864664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90f675f570d48fe9a8c494347b46fef'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:51.896880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-316c2f68-57c9-4940-a035-f95e67aa1e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90f675f570d48fe9a8c494347b46fef'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:52.000170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1107/2211] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:51 2022] DELETE /identity/v3/users/a90f675f570d48fe9a8c494347b46fef => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:52.020531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:52.748481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:52.962741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd730-4300-4623-949c-f7eba6096650 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:52.964398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-573dd730-4300-4623-949c-f7eba6096650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:52.988404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573dd730-4300-4623-949c-f7eba6096650 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:53.107659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:53.109598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.110766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.117516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] PATH_INFO: `/v3/projects/f007ed00c1ac43108491e58ee510cea8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.117516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f007ed00c1ac43108491e58ee510cea8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:53.117516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:53.267994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f007ed00c1ac43108491e58ee510cea8', 'request_id': 'req-70c6a70e-5e36-47a0-bc55-017d02759b32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:53.274178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f007ed00c1ac43108491e58ee510cea8', 'request_id': 'req-70c6a70e-5e36-47a0-bc55-017d02759b32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:53.280897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f007ed00c1ac43108491e58ee510cea8', 'request_id': 'req-70c6a70e-5e36-47a0-bc55-017d02759b32'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:53.413736 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] The token cache is being invalidate because project f007ed00c1ac43108491e58ee510cea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:53.414386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:53.415705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-70c6a70e-5e36-47a0-bc55-017d02759b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:53.418039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1105/2212] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:52 2022] DELETE /identity/v3/projects/f007ed00c1ac43108491e58ee510cea8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:53.423272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb0ca-774c-4a34-9890-d58583f53d42 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.423731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb0ca-774c-4a34-9890-d58583f53d42 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.424193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb0ca-774c-4a34-9890-d58583f53d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.450762 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-81dcb0ca-774c-4a34-9890-d58583f53d42 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:53.452605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-81dcb0ca-774c-4a34-9890-d58583f53d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:53.545583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1108/2213] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:53.554907 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.555479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.555992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.574926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.575234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.575518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.580465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:53.581743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:53.602504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] MFA Rules not processed for user `8a3020f93df64f2aab880322ef0c4c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:53.605139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:53.606022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1106/2214] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:53.609983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:53.625174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7dce-eec9-4d0b-9811-6adabd720ae6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:53.630779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:53.631624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.632105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.632380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.633271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:53.633732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:53.636104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:53.663102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1107/2215] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:53.669802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:53.683837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e41c6-2e24-4ad2-8fa4-309cd17ef0ef admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:53.690350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:53.691387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.691870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.692634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.693730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:53.696298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:53.715408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1109/2216] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:53.822210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1108/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:53.825526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:53.840157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a8811-f691-456b-8054-7b329c804e25 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:53.919262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:53.920035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.920427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.920695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.921852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:53.924548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:54.069684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1110/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:54.080079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:54.091671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03145980-5766-4e56-8835-c0b2efdc14ed admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:54.096703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:54.097350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:54.097686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:54.098044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:54.098831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:54.100298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:54.110921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1109/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:54.115007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:54.126383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d8459-a9f8-4756-b680-629b4521c9de admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:54.131040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:54.131629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:54.131904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:54.134638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:54.134638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:54.134638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd67dbe-48b2-4d88-a780-b3889834bee3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:54.148028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1111/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:54.150377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:54.161642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56cba7-8467-4654-b6a8-9fdff1708377 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:54.167324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:54.168100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:54.168393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:54.168817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] PATH_INFO: `/v3/projects/4fec9eaa0950408898c253422433d19e/users/82cb77e4e9254475b2fb557e39eb60d7/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:54.188116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fec9eaa0950408898c253422433d19e, user_id=82cb77e4e9254475b2fb557e39eb60d7, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:54.190237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:54.310652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1110/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:54 2022] PUT /identity/v3/projects/4fec9eaa0950408898c253422433d19e/users/82cb77e4e9254475b2fb557e39eb60d7/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:54.321673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:54.321870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:54.322760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:54.411909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] MFA Rules not processed for user `82cb77e4e9254475b2fb557e39eb60d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:54.413560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:54.500882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1112/2222] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:47:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:54.507563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:54.514596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:54.564896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:54.648112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214bcee-e638-40fb-83de-5aa73c3f03ac admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:54.658917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:54.660236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:54.661059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:54.661985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:54.688157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:54.701771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6fd2d-c3b6-4de4-82f4-b2e7322aa0a8 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:54.730508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1111/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:55.287146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:57.869783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:58.110151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:58.460091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:58.464156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:58.474106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc5122-b294-46dd-9fd9-c647f916d267 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:58.477954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:58.479172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:58.479461 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:58.479736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:58.481508 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:58.552656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:58.554095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:58.566574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1113/2224] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:00.028659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.433681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:02.238878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc2532-52ff-4f5e-b54e-0146965cefff None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.239493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc2532-52ff-4f5e-b54e-0146965cefff None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.239493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc2532-52ff-4f5e-b54e-0146965cefff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.259221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-43bc2532-52ff-4f5e-b54e-0146965cefff None None] MFA Rules not processed for user `b02ac305a83e4c58a3b12c739b64e237`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.261554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-43bc2532-52ff-4f5e-b54e-0146965cefff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.375906 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1112/2225] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.904247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.817869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.877780 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.879459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.007141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305becd3-07c3-4fc2-bdbc-35db0b7bafa5 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.012645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.013426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.013713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.014019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] PATH_INFO: `/v3/users/46614e576aba4f89a9ffd97b57c6612d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.015308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46614e576aba4f89a9ffd97b57c6612d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.018047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.237249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46614e576aba4f89a9ffd97b57c6612d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:04.238008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46614e576aba4f89a9ffd97b57c6612d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:04.245901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46614e576aba4f89a9ffd97b57c6612d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:04.246733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46614e576aba4f89a9ffd97b57c6612d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:04.260741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46614e576aba4f89a9ffd97b57c6612d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:04.384733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1114/2226] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:03 2022] DELETE /identity/v3/users/46614e576aba4f89a9ffd97b57c6612d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:04.389813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.390131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.390407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.416737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:04.418924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.493351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1113/2227] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:04.505185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.507518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.573871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b13-e7ba-4d60-8f1e-b1d30940b475 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.577570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.578210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.578491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.578765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.588233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.589669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.599706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1115/2228] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:04.819353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.820858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.882431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d042-ab55-4024-a132-2d9e5c7210ad None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.886010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.886608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.886893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.887342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.891048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.952909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.954438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.964339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1114/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:05.002726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.004244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.020242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a60-1df6-4c75-922b-82d8e2adfe61 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.026659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.027142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.027512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.027674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] PATH_INFO: `/v3/projects/fc39c52698cc48c48b443aae202fa0dc` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.028871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc39c52698cc48c48b443aae202fa0dc)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.030919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.392095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc39c52698cc48c48b443aae202fa0dc', 'request_id': 'req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.612283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc39c52698cc48c48b443aae202fa0dc', 'request_id': 'req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.623897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc39c52698cc48c48b443aae202fa0dc', 'request_id': 'req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.636121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] The token cache is being invalidate because project fc39c52698cc48c48b443aae202fa0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:05.636523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.637252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.638876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1116/2230] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:05 2022] DELETE /identity/v3/projects/fc39c52698cc48c48b443aae202fa0dc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:05.648895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.656787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423f0d7-75ce-424e-bc2b-419cf31cd544 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.740620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.741546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.741879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.742144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] PATH_INFO: `/v3/users/f68b87fda0e340108667ad97985d9075` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.743315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68b87fda0e340108667ad97985d9075)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.746461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.974922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68b87fda0e340108667ad97985d9075'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.982843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68b87fda0e340108667ad97985d9075'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.983591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68b87fda0e340108667ad97985d9075'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.984255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68b87fda0e340108667ad97985d9075'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.083443 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68b87fda0e340108667ad97985d9075'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.107942 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1115/2231] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:05 2022] DELETE /identity/v3/users/f68b87fda0e340108667ad97985d9075 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:06.715526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:06.846278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:06.848536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.862352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4ad4a-f6a3-48d5-aeec-f24eb89b607f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.943907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.944561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.944848 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.945127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] PATH_INFO: `/v3/projects/1fe130c91fd1469b87f56a6c77bf47bd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.951030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe130c91fd1469b87f56a6c77bf47bd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.953725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:07.086686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe130c91fd1469b87f56a6c77bf47bd', 'request_id': 'req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.205726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe130c91fd1469b87f56a6c77bf47bd', 'request_id': 'req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.212473 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe130c91fd1469b87f56a6c77bf47bd', 'request_id': 'req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.223796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] The token cache is being invalidate because project 1fe130c91fd1469b87f56a6c77bf47bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:07.224090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.224737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.226285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1117/2232] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:06 2022] DELETE /identity/v3/projects/1fe130c91fd1469b87f56a6c77bf47bd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:07.230430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.231849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.244621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ea087-4032-40c6-ade3-b4e7dab90c5b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:07.301370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:07.302112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.302400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.302677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] PATH_INFO: `/v3/users/903e00b3f76a41c694fc9a0615a0bc82` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.303821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903e00b3f76a41c694fc9a0615a0bc82)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:07.305772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:07.596972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903e00b3f76a41c694fc9a0615a0bc82'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.603842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903e00b3f76a41c694fc9a0615a0bc82'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.604516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903e00b3f76a41c694fc9a0615a0bc82'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.605130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903e00b3f76a41c694fc9a0615a0bc82'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.623257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:07.691796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7a8c9ba9-92c7-4b31-873e-ce50708df2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903e00b3f76a41c694fc9a0615a0bc82'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.709985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1116/2233] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:07 2022] DELETE /identity/v3/users/903e00b3f76a41c694fc9a0615a0bc82 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:07.875047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:08.376003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:08.378044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.396213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2cbd-1694-4ff8-905a-4bb8756548e0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.460664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.461316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.461604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.461875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] PATH_INFO: `/v3/projects/36df570ce1e145609a856cf0d3fe3571` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.463287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36df570ce1e145609a856cf0d3fe3571)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.465196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.614037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36df570ce1e145609a856cf0d3fe3571', 'request_id': 'req-f96244ba-ddbe-497b-bda6-60653f21ec7d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.708872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36df570ce1e145609a856cf0d3fe3571', 'request_id': 'req-f96244ba-ddbe-497b-bda6-60653f21ec7d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.716192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36df570ce1e145609a856cf0d3fe3571', 'request_id': 'req-f96244ba-ddbe-497b-bda6-60653f21ec7d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.726795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] The token cache is being invalidate because project 36df570ce1e145609a856cf0d3fe3571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:08.727079 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.727830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f96244ba-ddbe-497b-bda6-60653f21ec7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.729837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1118/2234] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:08 2022] DELETE /identity/v3/projects/36df570ce1e145609a856cf0d3fe3571 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:08.735728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.737553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.737553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.756913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:08.760514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.818528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1117/2235] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:08.828505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.828794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.829072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.848217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:08.849411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.857554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1119/2236] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:08.861779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:08.872096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df493-4a92-46ad-9e1e-d81ffbe1c9ca None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.876894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.877486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.877762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.878070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.878731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:08.879058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.880702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.893579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1118/2237] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:08.897839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:08.907353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbc5ff-3bb3-456a-998c-253f63215c4a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.911985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.912579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.912901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.913181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.913802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.915792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.031258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1120/2238] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:08 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:09.035862 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.046408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e9e7-e572-4bae-8f83-7364335ceca9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.103933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.104542 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.104822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.105095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.105730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.107676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.126273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:09.216557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1119/2239] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:09.218454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.230236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de945df-7638-4c7a-85e0-9e4e87a27655 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.255510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.256276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.256602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.256961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.257654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.259334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.272469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1121/2240] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:09.273828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.284757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91047f6-1a72-45ed-8dd9-f5e98af7b0c0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.289869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.304635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.304926 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.305207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.305887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.308154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d83ef2-5e41-46de-a54d-92531a7aeb65 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.323138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1120/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:09.326953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.338704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b914f9-b383-4874-bf0a-33631b7839a6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.345156 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.345834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.346228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.346541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] PATH_INFO: `/v3/projects/9e23c8b00f2c4d8b9c49b98656fe5e1a/users/b70b0820f17545508f83f750e5f243a5/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.363121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e23c8b00f2c4d8b9c49b98656fe5e1a, user_id=b70b0820f17545508f83f750e5f243a5, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.366821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.451485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1122/2242] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:09 2022] PUT /identity/v3/projects/9e23c8b00f2c4d8b9c49b98656fe5e1a/users/b70b0820f17545508f83f750e5f243a5/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:09.459019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.459315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.459597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.488945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] MFA Rules not processed for user `b70b0820f17545508f83f750e5f243a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:09.491840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.577163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.581574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1121/2243] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:09.652267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae579b2-cbdc-4f0b-99e7-0d7c88a551b4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.657434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.658083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.658366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.658799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.659436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.661421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.773439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1123/2244] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:09.777840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.788741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63f50e-c57b-40ff-abe8-46f1c410f180 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.844949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.851828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.851828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.851828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.851828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.851828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.931577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1122/2245] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:09.935622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.946065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ed0b-a4cd-49cf-bea2-8e8abcb39aef admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.951401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.951975 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.952262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.952582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.953234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.956239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.967405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1124/2246] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:09.971779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.982010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99832cb4-8a5e-45df-84fb-73787dbfcd93 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.987560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.987560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.987766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.988031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] PATH_INFO: `/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3/users/1d4f1ccb7e48421bbcca2de6b72e644e/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.002995 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6f1caa1caa46a099f2c684a1b027e3, user_id=1d4f1ccb7e48421bbcca2de6b72e644e, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.005651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.040959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:10.126617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1123/2247] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:09 2022] PUT /identity/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3/users/1d4f1ccb7e48421bbcca2de6b72e644e/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:10.130649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.141122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d475f-1e29-4041-9541-8bc1b828bbcb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.196186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.196793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.197076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.197347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.198620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.200294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcbc12-7fb5-4454-b549-3b9ba98e4047 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.211847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1125/2248] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:10.216732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.228231 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde5eab-7d59-4e9c-b932-4587a8246505 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.233036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.233689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.234039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.239872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] PATH_INFO: `/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3/users/1d4f1ccb7e48421bbcca2de6b72e644e/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.239872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6f1caa1caa46a099f2c684a1b027e3, user_id=1d4f1ccb7e48421bbcca2de6b72e644e, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.239872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.271414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1124/2249] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:10 2022] PUT /identity/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3/users/1d4f1ccb7e48421bbcca2de6b72e644e/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:10.272793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.273143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.273489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.314647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] MFA Rules not processed for user `1d4f1ccb7e48421bbcca2de6b72e644e`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:10.314647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.403207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1126/2250] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:10.415850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.417775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.487611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:10.490417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa54b7-d361-4a1b-b24a-bf0b938cc84b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.495290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.496318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.496600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.496872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.507772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.512465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.523834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1125/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:10.754380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.764232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e9869-8945-46e0-ad40-44c365e1e633 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.770168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.771352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.771826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.772913 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.855005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.856775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e221b-8352-46bf-8033-5322bf5e9d35 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.868336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1127/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:11.551139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.620294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff64a55-4a73-4067-9ba6-5a95fb5185ab service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.625537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.626300 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.626653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.627041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] PATH_INFO: `/v3/users/b70b0820f17545508f83f750e5f243a5` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.628853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70b0820f17545508f83f750e5f243a5)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.631304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.736803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:11.858505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70b0820f17545508f83f750e5f243a5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.867141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70b0820f17545508f83f750e5f243a5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.868048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70b0820f17545508f83f750e5f243a5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.868484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70b0820f17545508f83f750e5f243a5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.932459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70b0820f17545508f83f750e5f243a5'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.951235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1126/2253] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:11 2022] DELETE /identity/v3/users/b70b0820f17545508f83f750e5f243a5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:11.955731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.956097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.956449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.977348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:11.978683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.039188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1128/2254] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:12.055489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.057745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.124157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2610d4-f38f-48f6-8756-0d1309e7ba43 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.128274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.128565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.128844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.129117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.141059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.142731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.154249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1127/2255] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:12.695040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.697132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.717183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323758fc-6e08-4e74-894d-c8874b8e8715 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.721037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:12.734242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.736055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.736539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.737014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] PATH_INFO: `/v3/projects/9e23c8b00f2c4d8b9c49b98656fe5e1a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.739208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e23c8b00f2c4d8b9c49b98656fe5e1a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.741659 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.906154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e23c8b00f2c4d8b9c49b98656fe5e1a', 'request_id': 'req-3e632e03-8fd6-4530-8c53-f5a5c759112e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:12.996819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e23c8b00f2c4d8b9c49b98656fe5e1a', 'request_id': 'req-3e632e03-8fd6-4530-8c53-f5a5c759112e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.004587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e23c8b00f2c4d8b9c49b98656fe5e1a', 'request_id': 'req-3e632e03-8fd6-4530-8c53-f5a5c759112e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.015700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] The token cache is being invalidate because project 9e23c8b00f2c4d8b9c49b98656fe5e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:13.016151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.016922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.018818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1129/2256] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:12 2022] DELETE /identity/v3/projects/9e23c8b00f2c4d8b9c49b98656fe5e1a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:13.031932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.044521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b24c4-39ae-45ee-a2e3-2afca70de4ef service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.103094 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.103723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.104544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.104857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] PATH_INFO: `/v3/users/1d4f1ccb7e48421bbcca2de6b72e644e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.106085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4f1ccb7e48421bbcca2de6b72e644e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.108151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.378952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4f1ccb7e48421bbcca2de6b72e644e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.387385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4f1ccb7e48421bbcca2de6b72e644e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.388167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4f1ccb7e48421bbcca2de6b72e644e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.388788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4f1ccb7e48421bbcca2de6b72e644e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.540289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-78b34c21-8070-468a-8441-e968c70c07f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4f1ccb7e48421bbcca2de6b72e644e'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:13.567208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1128/2257] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:13 2022] DELETE /identity/v3/users/1d4f1ccb7e48421bbcca2de6b72e644e => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:13.743677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.181306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.181306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.203500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e632e03-8fd6-4530-8c53-f5a5c759112e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.267622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.272662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.272662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.272662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] PATH_INFO: `/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.272662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6f1caa1caa46a099f2c684a1b027e3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.272662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.441277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6f1caa1caa46a099f2c684a1b027e3', 'request_id': 'req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.544650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6f1caa1caa46a099f2c684a1b027e3', 'request_id': 'req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.554837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6f1caa1caa46a099f2c684a1b027e3', 'request_id': 'req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.601456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] The token cache is being invalidate because project 5e6f1caa1caa46a099f2c684a1b027e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:14.607789 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.608273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.608884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-44aaca5e-f7a8-4dc3-928d-e2eb65c4ef48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.608884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1130/2258] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:14 2022] DELETE /identity/v3/projects/5e6f1caa1caa46a099f2c684a1b027e3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.613601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.613893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.615293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.652405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.656641 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.745504 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1129/2259] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:14.753155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.754035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.754482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.794564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.794564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.811850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1131/2260] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:14.817217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.830168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a35b1-460d-4a37-86d9-3af01360a41b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.837155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.838311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.838596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.838882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.839597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:14.839903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.841577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.855581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1130/2261] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:48:14.861010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.884906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72758c43-708d-42ff-8970-051bce571dc3 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.897526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.898168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.898445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.898735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.899352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.901880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.028846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1132/2262] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:15.033828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.049041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1592bc-66f1-4fdf-aa21-c0f0f82f77cb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.135868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.136758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.142751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.143168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.143925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.146210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.266461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1131/2263] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:15.277005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.292660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3de9-43f5-4103-930e-76f7786123ca admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.305574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.308266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.308266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.308266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.313464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.318995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.342002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1133/2264] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:15.347358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.359920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8b6b8-ae70-434a-8d6a-d156225c6a83 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.367247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.368648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.369056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.369330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.370249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.377304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c41e1c-70cf-49c6-961f-5b5f70c1f890 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.388966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1132/2265] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:15.390236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.407706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc95a9-c911-46ad-9d69-ac8e80f3402e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.412876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.413580 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.413856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.414158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] PATH_INFO: `/v3/projects/5db62a0b8a75443ba4cb8b82c6959c14/users/da04d7a5afdf46938df7bacec991c327/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.434916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db62a0b8a75443ba4cb8b82c6959c14, user_id=da04d7a5afdf46938df7bacec991c327, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.438873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.575072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1134/2266] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:15 2022] PUT /identity/v3/projects/5db62a0b8a75443ba4cb8b82c6959c14/users/da04d7a5afdf46938df7bacec991c327/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:15.588420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.588769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.589042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.619322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] MFA Rules not processed for user `da04d7a5afdf46938df7bacec991c327`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:15.621098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.699697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1133/2267] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:15.713525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.716295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.814349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae58305-88bf-48d8-8101-4d69b6006aa7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.819277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.821497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.821497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.821497 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.830628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.832123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06409c2d-e16e-4fbc-bb5a-61fe4b5461b8 service glance] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.842136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1135/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:17.099998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.099998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.155846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:17.189087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b1e13-331a-4e5c-8933-99a01622349d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.197118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.198578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.198867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.199149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] PATH_INFO: `/v3/users/82cb77e4e9254475b2fb557e39eb60d7` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.200310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cb77e4e9254475b2fb557e39eb60d7)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:17.202620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:17.474357 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cb77e4e9254475b2fb557e39eb60d7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.485469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cb77e4e9254475b2fb557e39eb60d7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.486351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cb77e4e9254475b2fb557e39eb60d7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.487162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cb77e4e9254475b2fb557e39eb60d7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.566929 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cb77e4e9254475b2fb557e39eb60d7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.585453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1134/2269] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:17 2022] DELETE /identity/v3/users/82cb77e4e9254475b2fb557e39eb60d7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:17.590226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.590560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.590934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.617325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:17.618646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.684276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1136/2270] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:17.694798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.702680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.764776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466001-643a-4c80-a1c8-082e4d31f5c9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.768431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.769044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.769325 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.769602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.780214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:17.781674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dca4d6-8b4e-445f-9366-08181a9d2f1b service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:17.791937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1135/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:17.811490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:18.324183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.333158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:18.356797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b528b-acc7-4577-88db-00c23b265f50 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:18.362682 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:18.364561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.365071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.365478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] PATH_INFO: `/v3/projects/4fec9eaa0950408898c253422433d19e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.366857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fec9eaa0950408898c253422433d19e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:18.370515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.520000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fec9eaa0950408898c253422433d19e', 'request_id': 'req-f50b004b-7826-4614-8f10-4cb15f3e2989'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.612948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fec9eaa0950408898c253422433d19e', 'request_id': 'req-f50b004b-7826-4614-8f10-4cb15f3e2989'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.621667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fec9eaa0950408898c253422433d19e', 'request_id': 'req-f50b004b-7826-4614-8f10-4cb15f3e2989'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.632947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] The token cache is being invalidate because project 4fec9eaa0950408898c253422433d19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:18.633235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.634314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f50b004b-7826-4614-8f10-4cb15f3e2989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.635942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1137/2272] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:18 2022] DELETE /identity/v3/projects/4fec9eaa0950408898c253422433d19e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:18.642640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.643922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.643922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.683988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:18.685758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:18.771350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1136/2273] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:18.779809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.780095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.780366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.802524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:18.803901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:18.813973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1138/2274] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:18.817812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.822549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:18.832103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336e74e-0c09-473b-9f32-17e81febf98a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:18.837024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:18.837706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.838212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.839170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.839875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:18.840183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:18.841859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.853760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1137/2275] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:18.863755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.873465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b35f-430b-4c80-a47b-f1079590d714 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:18.878144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:18.878751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.879027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.879301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.879908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:18.881800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.973646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1139/2276] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:18 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:18.978043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.987955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc55bc-84bb-4952-a3f0-7da764055ca5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.044618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.045256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.045671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.045957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.046595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.049997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.175798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1138/2277] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:18 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:19.177985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:19.188430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b7ce-755d-4fb5-8469-f44d8347d18a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.192978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.193618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.193901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.194204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.194854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.196467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.206715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1140/2278] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:19.210796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:19.221614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450e86-f11a-4706-b05b-b6ba1adca9c1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.226642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.227273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.227841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.228316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.228925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.230633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01458dc-cfdb-4566-9e0a-96d97372bc65 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.242266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1139/2279] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:19.246732 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:19.257498 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad54052-5781-40be-bac8-c267d3cf691e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.263061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.263714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.263994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.264271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] PATH_INFO: `/v3/projects/c636e2d412e34f4e887d845a522e792e/users/9984fdbca7fd4bf48a5ca11292a334ff/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.282693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c636e2d412e34f4e887d845a522e792e, user_id=9984fdbca7fd4bf48a5ca11292a334ff, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.285525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.399958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1141/2280] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:19 2022] PUT /identity/v3/projects/c636e2d412e34f4e887d845a522e792e/users/9984fdbca7fd4bf48a5ca11292a334ff/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:19.411263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.412083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.412272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.442344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] MFA Rules not processed for user `9984fdbca7fd4bf48a5ca11292a334ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:19.443558 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:19.510998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1140/2281] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:19.523437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:19.525226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:19.583403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabe5a-3d4d-47f8-b202-c2157f4ea404 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.587574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.588195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.589002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.589281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.598252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.599700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41364c-4e24-43b6-b0b7-b45d4eacc601 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.609440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1142/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:19.716765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:20.446999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:21.035845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:21.830901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:22.790151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:23.424880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:23.778691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:24.612819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:25.294739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:25.543317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:27.014052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:27.078015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33afeaf-35e0-4b4a-a38d-10a0086891a9 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:27.083065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:27.083825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.084110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.085134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] PATH_INFO: `/v3/users/9984fdbca7fd4bf48a5ca11292a334ff` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.086087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9984fdbca7fd4bf48a5ca11292a334ff)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:27.088112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:27.201646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:27.298191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9984fdbca7fd4bf48a5ca11292a334ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.305289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9984fdbca7fd4bf48a5ca11292a334ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.306077 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9984fdbca7fd4bf48a5ca11292a334ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.306703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9984fdbca7fd4bf48a5ca11292a334ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.411228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9984fdbca7fd4bf48a5ca11292a334ff'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.430624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1141/2283] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:27 2022] DELETE /identity/v3/users/9984fdbca7fd4bf48a5ca11292a334ff => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:27.435795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354759-a293-4058-af97-3e19d9411b87 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.436262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354759-a293-4058-af97-3e19d9411b87 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.436506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354759-a293-4058-af97-3e19d9411b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.455935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-64354759-a293-4058-af97-3e19d9411b87 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:27.457287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-64354759-a293-4058-af97-3e19d9411b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.469692 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:27.526046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:27.537153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:27.538898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.605570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f348b11-4671-4680-880e-b2764814e681 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:27.609121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:27.609711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.610018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.610291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.619841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:27.621340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e2418-624d-4b1f-8e49-ec120e360ffe service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:27.631196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1142/2285] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:28.017423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:28.054935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354759-a293-4058-af97-3e19d9411b87 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:28.059622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-64354759-a293-4058-af97-3e19d9411b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:28.074447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354759-a293-4058-af97-3e19d9411b87 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:28.080561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:28.081225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:28.081511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:28.081787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] PATH_INFO: `/v3/projects/c636e2d412e34f4e887d845a522e792e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:28.083228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c636e2d412e34f4e887d845a522e792e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:28.085308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:28.196946 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c636e2d412e34f4e887d845a522e792e', 'request_id': 'req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.266139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c636e2d412e34f4e887d845a522e792e', 'request_id': 'req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.273200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c636e2d412e34f4e887d845a522e792e', 'request_id': 'req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.284287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] The token cache is being invalidate because project c636e2d412e34f4e887d845a522e792e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:28.284596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.285236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.286765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1144/2286] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:28 2022] DELETE /identity/v3/projects/c636e2d412e34f4e887d845a522e792e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:29.087661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:29.287239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.007615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.036076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.327803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.527956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.713780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241480-3b4e-48f5-9c25-1bbf22c5562e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.714757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241480-3b4e-48f5-9c25-1bbf22c5562e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.715039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82241480-3b4e-48f5-9c25-1bbf22c5562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.737642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-82241480-3b4e-48f5-9c25-1bbf22c5562e None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:30.738966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-82241480-3b4e-48f5-9c25-1bbf22c5562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.795162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1143/2287] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:30.839865 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:30.842632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.929040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ec9a6-90bf-42d0-97d6-3322dab50e6d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:30.935038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:30.935651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.935931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.936200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.945324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:30.950438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:30.955777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1145/2288] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.013253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.127944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.510696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.716032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.994209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e5ee-b4cc-4b0c-b614-951cd065ecdd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.994676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e5ee-b4cc-4b0c-b614-951cd065ecdd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.994821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33e5ee-b4cc-4b0c-b614-951cd065ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.014397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8f33e5ee-b4cc-4b0c-b614-951cd065ecdd None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:32.015671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f33e5ee-b4cc-4b0c-b614-951cd065ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.022783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1144/2289] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:32.035872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.040608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.047604 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da72169-d4f6-4623-8fb1-75a5f3a231d9 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.052954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.053554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.053839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.054138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.062868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.064444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.074153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1146/2290] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:32.322393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.693277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.750238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.821197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39b8c-c469-4585-990a-d4df2e40e3fd None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.821702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39b8c-c469-4585-990a-d4df2e40e3fd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.822223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39b8c-c469-4585-990a-d4df2e40e3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.842404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-59b39b8c-c469-4585-990a-d4df2e40e3fd None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:32.843749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-59b39b8c-c469-4585-990a-d4df2e40e3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.851145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1145/2291] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:32.863713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.874622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feab85-e802-4da2-b017-da953221fee8 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.879663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.880306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.880590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.881041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.889153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.890786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.898902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1147/2292] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.106019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.168517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.413754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.541373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:33.541373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:33.541671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:33.562644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:33.563846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:33.571283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1146/2293] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 03:48:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:33.583450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:33.591004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.596626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5239f-9abe-47a0-8635-0a2b7b9ea6f9 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:33.601665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:33.604292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:33.604292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:33.604292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:33.611683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:33.613273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc1469-6422-4d49-bbd9-fab65f3ff3df service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:33.621710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1148/2294] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.624973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.830288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:33.905178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.396177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.520569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.761916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.790575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.923037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:34.951129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.122848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.328052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.384852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.566205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.739136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.828991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.870470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:36.006308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:36.063518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:36.092054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:36.261422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.262939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.332087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d08101-6c7d-4499-b4ce-5a083b6fb127 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.338463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.339677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.340068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.341200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] PATH_INFO: `/v3/users/e14ae1ae55324c75b93776a386bffa14` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.343624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14ae1ae55324c75b93776a386bffa14)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.346835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:36.901623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14ae1ae55324c75b93776a386bffa14'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.910744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14ae1ae55324c75b93776a386bffa14'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.911525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14ae1ae55324c75b93776a386bffa14'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.912376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14ae1ae55324c75b93776a386bffa14'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:36.990428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14ae1ae55324c75b93776a386bffa14'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.002398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:37.020438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1147/2295] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:36 2022] DELETE /identity/v3/users/e14ae1ae55324c75b93776a386bffa14 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:37.029155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.030258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.031950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.078412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:37.079642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.169455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1149/2296] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:37.177822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.179347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.238185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753e717-5321-43ed-8db7-dcf460df48f8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:37.242024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:37.246235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.246235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.246235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.253805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.255328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b17b-f517-47d6-b0a4-db7d2b4c8a97 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.265640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1148/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:37.345918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:37.570434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.571995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.584621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b57514-b3a9-4598-aeec-f77c00709edf None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:37.590761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:37.594912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.594912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.594912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] PATH_INFO: `/v3/projects/466770b6707347f380b161b8d2668940` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.594912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=466770b6707347f380b161b8d2668940)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.598329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.729268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466770b6707347f380b161b8d2668940', 'request_id': 'req-9c4489ec-0b14-4b76-8ef5-82ca55b49976'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.796091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466770b6707347f380b161b8d2668940', 'request_id': 'req-9c4489ec-0b14-4b76-8ef5-82ca55b49976'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.803065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466770b6707347f380b161b8d2668940', 'request_id': 'req-9c4489ec-0b14-4b76-8ef5-82ca55b49976'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.814932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] The token cache is being invalidate because project 466770b6707347f380b161b8d2668940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:37.815310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.816490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-9c4489ec-0b14-4b76-8ef5-82ca55b49976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.818105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1150/2298] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:37 2022] DELETE /identity/v3/projects/466770b6707347f380b161b8d2668940 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:37.823011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.830073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.830073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.852465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:37.852465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.852694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:37.904757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1149/2299] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:37.913118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.913404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.913677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.933155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:37.934471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.944410 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1151/2300] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:37.947295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.958157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054a602-9979-4422-b60e-5a11c3dc19f6 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:37.963234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:37.963949 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.964268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.965298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.966049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:37.966354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.967968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.980317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1150/2301] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:37.985721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.995181 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98613e82-66a8-400f-9224-5d18f5e51bf3 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.000225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.001439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.001717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.007519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.007519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.007519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.099331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1152/2302] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:38.103612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.113808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44d891-53b6-463e-890e-b35b9317a689 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.173888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.173888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.174258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.174546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.175173 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.177190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.286837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1151/2303] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:38 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:38.290881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.301518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678d4c-74c9-4992-a7fe-def06244389c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.306333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.306937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.307212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.307484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.308665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.310287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.320192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1153/2304] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:38.325065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.335454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dcd8c-7a69-4f62-b308-6a0ba2b06fe1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.341034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.341636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.341961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.342263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.342903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.344490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe92b6-c0c2-48a2-83e8-f724555bb2ba admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.355511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1152/2305] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:38.359800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.372116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2951081-27a1-4b8b-ad1c-5d68ca55d5d2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.377633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.378312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.378614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.378881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] PATH_INFO: `/v3/projects/b1dd08f3210242e48b2e6f2ae67e6cce/users/81dc9a31b6ee468b9bda89f965efb901/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.394324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dd08f3210242e48b2e6f2ae67e6cce, user_id=81dc9a31b6ee468b9bda89f965efb901, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.397420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.436407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.500270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1154/2306] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:38 2022] PUT /identity/v3/projects/b1dd08f3210242e48b2e6f2ae67e6cce/users/81dc9a31b6ee468b9bda89f965efb901/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:38.510467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee826a-a10e-42c6-88c0-513a660d6925 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.510820 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee826a-a10e-42c6-88c0-513a660d6925 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.511256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee826a-a10e-42c6-88c0-513a660d6925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.541572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-91ee826a-a10e-42c6-88c0-513a660d6925 None None] MFA Rules not processed for user `81dc9a31b6ee468b9bda89f965efb901`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:38.543663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-91ee826a-a10e-42c6-88c0-513a660d6925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.613435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1153/2307] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:38.625613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.627345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.687983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d1a4-7382-4ef4-ab83-d91e28808ab9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.697224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.697463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.697750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.698078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.705777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:38.709387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.710951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.720614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1155/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:38.756506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:39.070973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:39.104833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:39.534622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:39.928857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.071073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.145489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.545233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.665412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.933983 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:41.253562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:41.448445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4dcd-bfd5-45c0-b565-25b3898c728f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.448948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4dcd-bfd5-45c0-b565-25b3898c728f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.449038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4dcd-bfd5-45c0-b565-25b3898c728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.468054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-66fa4dcd-bfd5-45c0-b565-25b3898c728f None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:41.469268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-66fa4dcd-bfd5-45c0-b565-25b3898c728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.530190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1154/2309] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:41.545504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.545504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.623392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3309-0763-48f3-bc15-19a5da8c14e1 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.628547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.629299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.629578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.629875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.643137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.644246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.653705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1156/2310] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:41.679527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.680095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.680456 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.702853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] MFA Rules not processed for user `8947c9cf75d642c88f1dc2f4382025bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:41.704062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.762609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1155/2311] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:41.854674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:42.460003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:43.207744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:43.484978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.487207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.569378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f8ffe-5832-434a-a13b-049e57d216d4 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.575873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.576819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.577313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.577832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] PATH_INFO: `/v3/users/443fc38b48a7412e9c748a2f850dba8a` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.579242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] RBAC: Authorizing `identity:delete_user(user_id=443fc38b48a7412e9c748a2f850dba8a)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.581391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.809354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443fc38b48a7412e9c748a2f850dba8a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.811350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443fc38b48a7412e9c748a2f850dba8a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.820030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443fc38b48a7412e9c748a2f850dba8a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.821150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443fc38b48a7412e9c748a2f850dba8a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.847012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443fc38b48a7412e9c748a2f850dba8a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.936328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1157/2312] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:43 2022] DELETE /identity/v3/users/443fc38b48a7412e9c748a2f850dba8a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:44.191025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:44.243198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:44.283366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:44.318261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbebb5a-310a-4ebf-a3c8-96c83ed300a2 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:44.424397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:44.425349 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:44.425789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:44.426393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] PATH_INFO: `/v3/projects/a953011c91fe401b80f234988dd3f67b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:44.427744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a953011c91fe401b80f234988dd3f67b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:44.429897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:44.591088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a953011c91fe401b80f234988dd3f67b', 'request_id': 'req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.597405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a953011c91fe401b80f234988dd3f67b', 'request_id': 'req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.604981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a953011c91fe401b80f234988dd3f67b', 'request_id': 'req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.729517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] The token cache is being invalidate because project a953011c91fe401b80f234988dd3f67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:44.731116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.732053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.734355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1156/2313] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:44 2022] DELETE /identity/v3/projects/a953011c91fe401b80f234988dd3f67b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:44.738630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:44.741359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:44.771654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da8be-fe24-4b97-a474-23b5a8c5faca admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:44.791103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:44.854197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:44.858138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:44.858138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:44.858138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] PATH_INFO: `/v3/users/3f68cc6e75cb4624bb5c69c8cd048619` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:44.858138 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f68cc6e75cb4624bb5c69c8cd048619)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:44.860124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:44.901049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.081487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f68cc6e75cb4624bb5c69c8cd048619'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.082376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f68cc6e75cb4624bb5c69c8cd048619'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.100680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f68cc6e75cb4624bb5c69c8cd048619'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.101625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f68cc6e75cb4624bb5c69c8cd048619'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.114145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c4c579bc-fbc2-4c5c-955e-d11e7edfce61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f68cc6e75cb4624bb5c69c8cd048619'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.186137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1158/2314] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:44 2022] DELETE /identity/v3/users/3f68cc6e75cb4624bb5c69c8cd048619 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:45.512289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.514463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:45.536833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8ac1-b308-4e24-b170-7d3c0b3c627d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.621850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.669229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.670627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.671582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.672148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] PATH_INFO: `/v3/projects/a00358b9cc5e4e1487edc1fe5da99790` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.677482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00358b9cc5e4e1487edc1fe5da99790)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.678850 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.837872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00358b9cc5e4e1487edc1fe5da99790', 'request_id': 'req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.846492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00358b9cc5e4e1487edc1fe5da99790', 'request_id': 'req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.855358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00358b9cc5e4e1487edc1fe5da99790', 'request_id': 'req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.929355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] The token cache is being invalidate because project a00358b9cc5e4e1487edc1fe5da99790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:45.929727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.930422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f98d7d8b-e7b4-444a-823f-8aec9d80aa24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.933360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1157/2315] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:45 2022] DELETE /identity/v3/projects/a00358b9cc5e4e1487edc1fe5da99790 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:45.940377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.940952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.941354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.962999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:45.964499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.005699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:46.064608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1159/2316] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:46.070913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.071273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.071620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.100805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:46.100805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.124072 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1158/2317] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:46.124380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.139719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e4ba5-6d42-4166-91e8-d90755aa4f3a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.151422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.152791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.153571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.153855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.154576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:46.154880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.165115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.179891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:46.186680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1160/2318] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:46.197855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.213793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa196c31-8d51-47c0-8f48-e0701cc8acc8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.220028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.220793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.221165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.221606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.222690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.225045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.351229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1159/2319] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:46.356252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.374062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814f3e-ad29-45e4-b3af-76908cd6804c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.484315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.485142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.485521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.485927 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.486842 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.489043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.590489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1161/2320] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:46.595215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.614774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc0706-3811-4539-8b9c-4299e3992c2f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.623050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.623670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.624625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.624625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.624912 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.626602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.643019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1160/2321] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:46.646882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.679977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c51c4-f9f5-4331-9cba-2d65729d26eb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.694894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.695792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.696276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.696636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.698294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.705101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ad8ad-bd45-460e-9307-94c483bd154f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.723614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1162/2322] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:46.732663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.743550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c080b6-36fe-4b40-801a-aa56318fe003 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.751921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.753136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.753903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.754380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] PATH_INFO: `/v3/projects/8ea3a552ed164114af6cd8025af72675/users/bb879edf2c1a4040b3db965ae7c5d06c/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.781436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea3a552ed164114af6cd8025af72675, user_id=bb879edf2c1a4040b3db965ae7c5d06c, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.785046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.904481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1161/2323] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:46 2022] PUT /identity/v3/projects/8ea3a552ed164114af6cd8025af72675/users/bb879edf2c1a4040b3db965ae7c5d06c/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:46.920091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.920310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.920681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.979893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] MFA Rules not processed for user `bb879edf2c1a4040b3db965ae7c5d06c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:46.981188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:47.030978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:47.140609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1163/2324] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:47.151813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.318935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39774ec-9a32-46ac-abb1-72acd73fb9bd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.341019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.341650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.341923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.342707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.343537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.345468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.363807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:47.494301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1162/2325] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:47 2022] POST /identity/v3/projects => generated 383 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:47.499281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.514482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76676abb-0c51-4b15-b2e3-0b73bb7ca262 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.567974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:47.637243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.638058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.638444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.638825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.639578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.641752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.796246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1164/2326] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:47 2022] POST /identity/v3/users => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:47.797977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.825668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83379b1-c70e-48a6-88d9-4af458cda79e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.833714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.834885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.836081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.836778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.837640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.839548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.853070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1163/2327] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:47.858258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.873317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af969-d5b3-406d-9dd5-f8b072318ff1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:47.884262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:47.884955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:47.885285 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:47.885606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] PATH_INFO: `/v3/projects/c15e244543da40a9911419803c009544/users/32c5b403dd69477f81834c8e91bbb56a/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:47.910175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15e244543da40a9911419803c009544, user_id=32c5b403dd69477f81834c8e91bbb56a, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:47.913563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.016199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1165/2328] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:47 2022] PUT /identity/v3/projects/c15e244543da40a9911419803c009544/users/32c5b403dd69477f81834c8e91bbb56a/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:48.020496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.033499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bf27-f256-4361-953a-7d71a7c784de admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.118024 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.119100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.119457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.119783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.120683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.124471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1dcfb-3568-4cd7-9af2-90f613c165e7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.145267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1164/2329] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:48.147552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.165016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ddc37-f742-4f46-8611-4b2636626ca0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.171954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.172819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:48.173486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.174619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.181216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] PATH_INFO: `/v3/projects/c15e244543da40a9911419803c009544/users/32c5b403dd69477f81834c8e91bbb56a/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.181216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15e244543da40a9911419803c009544, user_id=32c5b403dd69477f81834c8e91bbb56a, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.181216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.194616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1166/2330] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:48 2022] PUT /identity/v3/projects/c15e244543da40a9911419803c009544/users/32c5b403dd69477f81834c8e91bbb56a/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:48.205059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.209773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.209773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.238059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] MFA Rules not processed for user `32c5b403dd69477f81834c8e91bbb56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:48.239261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.344257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1165/2331] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:48.356775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.359178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.494986 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd69ff-8bcb-4e09-b0d1-7efa65a1ef99 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.501434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.502132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.502628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.502855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.601026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.602910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c101c0-da29-498b-9315-f06013c29009 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.616698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1167/2332] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:48.653734 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:48.968680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:49.322569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.597243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:52.599822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.614053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.682782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b4f8-06f7-4ff2-869c-8a5f43a7543e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:52.688209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:52.689467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.690309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.690816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] PATH_INFO: `/v3/users/81dc9a31b6ee468b9bda89f965efb901` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.693832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dc9a31b6ee468b9bda89f965efb901)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:52.699127 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:52.882891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dc9a31b6ee468b9bda89f965efb901'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.892172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dc9a31b6ee468b9bda89f965efb901'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.892999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dc9a31b6ee468b9bda89f965efb901'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.893624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dc9a31b6ee468b9bda89f965efb901'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.962738 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dc9a31b6ee468b9bda89f965efb901'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.990007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1166/2333] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:52 2022] DELETE /identity/v3/users/81dc9a31b6ee468b9bda89f965efb901 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:52.999425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.999425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.999425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.030585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:53.032890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:53.088284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:53.154064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1168/2334] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:53.164606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.166518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:53.283038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5d3ad-4a8c-4e10-8b14-651ede32ba51 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:53.287868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:53.288554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:53.288834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:53.292033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.299503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:53.301377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:53.333054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1167/2335] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:53.826405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.826405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:53.881166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733cc72-dc13-44e8-8872-26c06139ddad None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:53.886836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:53.887517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:53.887804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:53.888082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] PATH_INFO: `/v3/projects/b1dd08f3210242e48b2e6f2ae67e6cce` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.894186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1dd08f3210242e48b2e6f2ae67e6cce)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:53.894186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.100558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1dd08f3210242e48b2e6f2ae67e6cce', 'request_id': 'req-6670ed8d-a407-4040-b29b-e816a5289079'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.197048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1dd08f3210242e48b2e6f2ae67e6cce', 'request_id': 'req-6670ed8d-a407-4040-b29b-e816a5289079'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.204979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1dd08f3210242e48b2e6f2ae67e6cce', 'request_id': 'req-6670ed8d-a407-4040-b29b-e816a5289079'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.217679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] The token cache is being invalidate because project b1dd08f3210242e48b2e6f2ae67e6cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:54.218271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.219340 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-6670ed8d-a407-4040-b29b-e816a5289079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.221452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1169/2336] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:53 2022] DELETE /identity/v3/projects/b1dd08f3210242e48b2e6f2ae67e6cce => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:55.628852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.631092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.650747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345a564-88ef-4eeb-9f29-6b6e0f09acbb service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.701714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:55.739335 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.740145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.741323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.741705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] PATH_INFO: `/v3/users/da04d7a5afdf46938df7bacec991c327` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.743054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da04d7a5afdf46938df7bacec991c327)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.745098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.975735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da04d7a5afdf46938df7bacec991c327'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.984956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da04d7a5afdf46938df7bacec991c327'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.985548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da04d7a5afdf46938df7bacec991c327'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.985730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da04d7a5afdf46938df7bacec991c327'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:56.062636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da04d7a5afdf46938df7bacec991c327'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:56.096830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1168/2337] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:55 2022] DELETE /identity/v3/users/da04d7a5afdf46938df7bacec991c327 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:56.101395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.102248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.102530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.132218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:56.134203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.209127 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1170/2338] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:56.219659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.221172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.310341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9445049-ecec-4db1-9b0f-75490f5ce06c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.316340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.316968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.318474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.318474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.329827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.331509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.352584 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1169/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:56.475550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.477974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.593721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5ec22-aec6-4dc1-b1ef-cd5335a751b3 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.598831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.599466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.599745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.601449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.602071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.617336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:56.733675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.735312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da7ca-90d2-4007-83b4-3086a96f92b0 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.747343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1171/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:56.952515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.954885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.971503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff5b7f-8922-4df8-9cd8-c95d15441157 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.977613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.978671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.979007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.979466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] PATH_INFO: `/v3/projects/5db62a0b8a75443ba4cb8b82c6959c14` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.980661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db62a0b8a75443ba4cb8b82c6959c14)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.982878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.104482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:57.108146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db62a0b8a75443ba4cb8b82c6959c14', 'request_id': 'req-4cc04d16-07c5-408d-a53b-2dd111dc588c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.117979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db62a0b8a75443ba4cb8b82c6959c14', 'request_id': 'req-4cc04d16-07c5-408d-a53b-2dd111dc588c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.141408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db62a0b8a75443ba4cb8b82c6959c14', 'request_id': 'req-4cc04d16-07c5-408d-a53b-2dd111dc588c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.224793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] The token cache is being invalidate because project 5db62a0b8a75443ba4cb8b82c6959c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:57.224793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.224793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-4cc04d16-07c5-408d-a53b-2dd111dc588c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.224793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1170/2341] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:56 2022] DELETE /identity/v3/projects/5db62a0b8a75443ba4cb8b82c6959c14 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.229805 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.231370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.231903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.260397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:57.262077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.331688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1172/2342] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:57.339802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.340063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.340918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.366806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:57.367964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.379991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1171/2343] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:57.389987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.402142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d2040-091f-4f49-8ac4-c010a1588dff None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.419778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.420414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.420694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.420967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.421637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:57.421989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.423620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.440159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1173/2344] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:57.450876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.460557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2cb3-08ec-4cd9-b4c0-e43e05f38a25 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.465918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.466609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.466911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.467187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.467851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.469761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.608282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1172/2345] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.618679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.632825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681246-b763-4e43-950e-204975456fbc admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.703244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.703960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.704320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.704672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.705389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.707572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.820448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1174/2346] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.827108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.837924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767783df-cf68-4c20-a55b-3970bb1918f6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.842806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.843432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.843743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.844018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.844664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.846355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.862046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1173/2347] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:57.864487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.877912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4f7ef-bb45-483e-89d1-9f146c3562b1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.883595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.884198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.887819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.887819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.887819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.887819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b92fea-8be0-45e2-9e8a-06e40563cfe4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.904481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1175/2348] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:57.908647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.925858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf429-891f-44ff-b9e6-143fdac08262 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.942834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.943539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.943895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.944175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] PATH_INFO: `/v3/projects/7b6487bf78f349daa3d33053b1c48a0c/users/fa3c27c566e543efa50013e5adf19fcd/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.965429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6487bf78f349daa3d33053b1c48a0c, user_id=fa3c27c566e543efa50013e5adf19fcd, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.968157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.053164 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1174/2349] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:57 2022] PUT /identity/v3/projects/7b6487bf78f349daa3d33053b1c48a0c/users/fa3c27c566e543efa50013e5adf19fcd/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.058257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f866-6796-4118-898c-ce3a721727cb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.058545 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f866-6796-4118-898c-ce3a721727cb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.058821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f866-6796-4118-898c-ce3a721727cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.078408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a182f866-6796-4118-898c-ce3a721727cb None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:58.079660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a182f866-6796-4118-898c-ce3a721727cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.087738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:58.140016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1176/2350] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:58.149771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.152683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.222531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2b848-74a2-475e-b4da-ea93cde30660 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.227151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.227745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.228026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.228296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.238647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.240087 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32106d-4e5a-4ea9-af6f-3a81f2e07bad service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.250687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1175/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:04.218741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182f866-6796-4118-898c-ce3a721727cb None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.220306 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a182f866-6796-4118-898c-ce3a721727cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.234478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182f866-6796-4118-898c-ce3a721727cb None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.239965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.241203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.241203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.241424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] PATH_INFO: `/v3/users/bb879edf2c1a4040b3db965ae7c5d06c` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.242844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb879edf2c1a4040b3db965ae7c5d06c)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.244793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.481208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb879edf2c1a4040b3db965ae7c5d06c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.490371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb879edf2c1a4040b3db965ae7c5d06c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.503111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb879edf2c1a4040b3db965ae7c5d06c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.503940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb879edf2c1a4040b3db965ae7c5d06c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.528523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb879edf2c1a4040b3db965ae7c5d06c'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.593470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1177/2352] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:04 2022] DELETE /identity/v3/users/bb879edf2c1a4040b3db965ae7c5d06c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:04.597831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce813-1582-4d59-9e80-b59bd1070b04 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.598407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce813-1582-4d59-9e80-b59bd1070b04 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.598407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fce813-1582-4d59-9e80-b59bd1070b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.620134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-75fce813-1582-4d59-9e80-b59bd1070b04 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:04.621807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-75fce813-1582-4d59-9e80-b59bd1070b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.693483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1176/2353] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:04.703548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.707099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.786485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db6d67-096a-4bbb-876f-fce85c12f2e4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.790513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.791644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.791928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.792201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.805097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.806620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.832010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1178/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:05.014450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58e29-fa20-497a-8359-6c4412cd5263 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.014814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58e29-fa20-497a-8359-6c4412cd5263 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.015660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58e29-fa20-497a-8359-6c4412cd5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.041729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d8f58e29-fa20-497a-8359-6c4412cd5263 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:05.043334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d8f58e29-fa20-497a-8359-6c4412cd5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.054824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.129543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1177/2355] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:05.149307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.151309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.352175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.352503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.352726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.369871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.392033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] MFA Rules not processed for user `fa3c27c566e543efa50013e5adf19fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:05.393273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.428314 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89e64-fc37-439c-ad55-47ce03b44a05 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.433895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.435133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.435385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.435652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.444743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.446588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.456303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1179/2356] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:05.473982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1178/2357] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:05.488666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.488666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.507720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4c3f9-46b7-4188-bc27-3233ae2effc0 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.512380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.513065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.513341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.513611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.514296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.516184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.549842 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.551492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.573181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841edd9-cd54-4178-8459-a66f4e46cc7c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.586066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.586066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.586066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.586066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] PATH_INFO: `/v3/projects/8ea3a552ed164114af6cd8025af72675` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.587154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea3a552ed164114af6cd8025af72675)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.587154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.640740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1180/2358] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:05.645613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.715982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cffa1-8a8b-4511-873e-c33b48b59d7a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.728682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea3a552ed164114af6cd8025af72675', 'request_id': 'req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.736129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea3a552ed164114af6cd8025af72675', 'request_id': 'req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.744745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea3a552ed164114af6cd8025af72675', 'request_id': 'req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.779664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.779664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.779926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.780109 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.781009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.782646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.838022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] The token cache is being invalidate because project 8ea3a552ed164114af6cd8025af72675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:05.838322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.838975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.841098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1179/2359] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:05 2022] DELETE /identity/v3/projects/8ea3a552ed164114af6cd8025af72675 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:05.845446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.847267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.867745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213a7d1-5441-4d8e-a37e-4ebfdc3089b6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.875416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.876451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.876905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.877385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] PATH_INFO: `/v3/users/32c5b403dd69477f81834c8e91bbb56a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.881823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1181/2360] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:05.882263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c5b403dd69477f81834c8e91bbb56a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.882263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.883639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.885630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.902302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555851f-62ca-479d-b812-1f513fe24de5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.911723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.912687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.913113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.913571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.915046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.917709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.930472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1182/2361] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:05.934680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.945361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b0db-c854-443d-b28d-a0c705ac90d8 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.950159 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.950840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.951114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.951402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] PATH_INFO: `/v3/projects/62f3d15c576e41ae95294725c713dd47/users/dab7ddd214674cb3ad7d67a98ef0cc92/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.968355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f3d15c576e41ae95294725c713dd47, user_id=dab7ddd214674cb3ad7d67a98ef0cc92, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.971035 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.987089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:06.065395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:06.071912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1183/2362] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:05 2022] PUT /identity/v3/projects/62f3d15c576e41ae95294725c713dd47/users/dab7ddd214674cb3ad7d67a98ef0cc92/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:06.076008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.146013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c5b403dd69477f81834c8e91bbb56a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.170184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1879-2fe0-4f8f-a309-4ae36f55c47c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.175375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c5b403dd69477f81834c8e91bbb56a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.175918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.176243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c5b403dd69477f81834c8e91bbb56a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.176690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.177036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.177157 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c5b403dd69477f81834c8e91bbb56a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.177431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.178189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.179896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.201879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1184/2363] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:06.206962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.218195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.231402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dee98e-f6c9-4b23-beb3-b97d9dd24f11 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.236492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.237154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.237437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.237731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] PATH_INFO: `/v3/projects/62f3d15c576e41ae95294725c713dd47/users/dab7ddd214674cb3ad7d67a98ef0cc92/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.239715 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f3d15c576e41ae95294725c713dd47, user_id=dab7ddd214674cb3ad7d67a98ef0cc92, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.242506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.255153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1185/2364] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:06 2022] PUT /identity/v3/projects/62f3d15c576e41ae95294725c713dd47/users/dab7ddd214674cb3ad7d67a98ef0cc92/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:06.278660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c5b403dd69477f81834c8e91bbb56a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.303714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1180/2365] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:05 2022] DELETE /identity/v3/users/32c5b403dd69477f81834c8e91bbb56a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:06.868008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.872816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.947297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9301-5b83-4188-a456-671f309ae1b5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.015087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.015736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.016016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.016293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] PATH_INFO: `/v3/projects/c15e244543da40a9911419803c009544` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.017433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15e244543da40a9911419803c009544)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.020706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.100583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:07.114493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15e244543da40a9911419803c009544', 'request_id': 'req-07750cab-27f2-4ee7-9e48-a5a82ed4235e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.169516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15e244543da40a9911419803c009544', 'request_id': 'req-07750cab-27f2-4ee7-9e48-a5a82ed4235e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.177249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15e244543da40a9911419803c009544', 'request_id': 'req-07750cab-27f2-4ee7-9e48-a5a82ed4235e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.189615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] The token cache is being invalidate because project c15e244543da40a9911419803c009544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:07.190266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.190592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:07.192391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1186/2366] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:06 2022] DELETE /identity/v3/projects/c15e244543da40a9911419803c009544 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:09.097883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.099514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:09.128021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0527-2ff1-4b02-89e6-038996664611 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.197378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.198162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.198507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.198859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] PATH_INFO: `/v3/users/b02ac305a83e4c58a3b12c739b64e237` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.200673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02ac305a83e4c58a3b12c739b64e237)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.202740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.403848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02ac305a83e4c58a3b12c739b64e237'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:09.415134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02ac305a83e4c58a3b12c739b64e237'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:09.416022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02ac305a83e4c58a3b12c739b64e237'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:09.417118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02ac305a83e4c58a3b12c739b64e237'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:09.506491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-27d0a268-bddd-4fcb-b735-a84fc7fda1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02ac305a83e4c58a3b12c739b64e237'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:09.529187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1181/2367] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:09 2022] DELETE /identity/v3/users/b02ac305a83e4c58a3b12c739b64e237 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:09.824119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.826302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:09.846185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750cab-27f2-4ee7-9e48-a5a82ed4235e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.921467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.922712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.923224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.923724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] PATH_INFO: `/v3/projects/3858a1cc836046b5b89e87f21285fc17` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.925316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3858a1cc836046b5b89e87f21285fc17)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.927492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.085353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3858a1cc836046b5b89e87f21285fc17', 'request_id': 'req-95138dd9-f4ed-49db-9f2b-87c4460b9feb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.186329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3858a1cc836046b5b89e87f21285fc17', 'request_id': 'req-95138dd9-f4ed-49db-9f2b-87c4460b9feb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.196072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3858a1cc836046b5b89e87f21285fc17', 'request_id': 'req-95138dd9-f4ed-49db-9f2b-87c4460b9feb'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.211739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] The token cache is being invalidate because project 3858a1cc836046b5b89e87f21285fc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:10.212388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.213158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-95138dd9-f4ed-49db-9f2b-87c4460b9feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:10.224864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1187/2368] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:09 2022] DELETE /identity/v3/projects/3858a1cc836046b5b89e87f21285fc17 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:10.229442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.230400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.230849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.265386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:10.267434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:10.291099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:10.339836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1182/2369] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:10.355370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.355370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.355370 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.371102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:10.373684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:10.383026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1188/2370] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:10.387495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.400485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d81d-f83f-4314-84ab-cc1e9349fa5d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.407525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.409047 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.409968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.410369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.411384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:10.411794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.413748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.433868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1183/2371] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:10.438994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.451048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc08eb-4a10-4e61-baa6-192eaf9e35b4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.459624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.459624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.459624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.459624 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.461266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.463581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.553084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1189/2372] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:10.556244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.571079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f6304-a876-427f-b636-9c1d81857c01 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.642821 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.643588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.644277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.644672 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.645298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.648342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.708191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1184/2373] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:10.712884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.724817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f351ec0-16e7-4bad-9a72-923e8ff4eae6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.730184 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.730888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.731163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.732063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.732697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.734333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.748769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1190/2374] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:10.751343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.762184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515a71-2f2c-4561-9127-780ab4c63392 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.767751 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.768530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.769069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.769444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.770222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.772154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65314eec-c0b8-4655-b0ad-52fde0671501 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.785592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1185/2375] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:10.789754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:10.800644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab47cd-ea5e-42e0-afde-6993844ae3a9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:10.805360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:10.806123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.806405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.806681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] PATH_INFO: `/v3/projects/ca3fbce57c02447aaace5daf33319e70/users/1c9ee4b007d9428da53466a0d97053e4/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.810367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:10.822480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3fbce57c02447aaace5daf33319e70, user_id=1c9ee4b007d9428da53466a0d97053e4, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:10.825711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:10.879241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1191/2376] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:10 2022] PUT /identity/v3/projects/ca3fbce57c02447aaace5daf33319e70/users/1c9ee4b007d9428da53466a0d97053e4/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:10.889770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1ad-5568-4d08-a18c-97243c315ddb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:10.890359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1ad-5568-4d08-a18c-97243c315ddb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:10.890803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b1ad-5568-4d08-a18c-97243c315ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:10.921827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-0d31b1ad-5568-4d08-a18c-97243c315ddb None None] MFA Rules not processed for user `1c9ee4b007d9428da53466a0d97053e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:10.923805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0d31b1ad-5568-4d08-a18c-97243c315ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.009834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1186/2377] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:11.021987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:11.023904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.100671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16766b9a-d54f-4267-b7fb-6491ed91b526 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:11.105232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:11.105921 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.106303 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.106784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.117467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:11.119119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:11.130174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1192/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:12.724061 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5a1a-2b6d-443b-b937-f192d3f1ad83 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.724622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5a1a-2b6d-443b-b937-f192d3f1ad83 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.724757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f5a1a-2b6d-443b-b937-f192d3f1ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.758477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-692f5a1a-2b6d-443b-b937-f192d3f1ad83 None None] MFA Rules not processed for user `dab7ddd214674cb3ad7d67a98ef0cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.759771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-692f5a1a-2b6d-443b-b937-f192d3f1ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.767350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:12.850174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1187/2379] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:12.865302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.867646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.954709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005420e9-e396-4f6f-89d0-c5f81978eb70 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.963995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.964778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.965065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.965343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.967261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.044796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.046586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a74f6c-e0c9-42e3-a6b3-6de04019488c service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.058021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1193/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:15.822360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.822834 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.822927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.842104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] MFA Rules not processed for user `fa3c27c566e543efa50013e5adf19fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:15.843285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.850426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1188/2381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.014021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.014517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.014748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.035867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.037189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.056892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:20.099020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1194/2382] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.112272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.113611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.205972 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2ceb-d028-42b8-918e-bc5e83a4de3b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.211062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.211670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.211951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.212228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.221133 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.222756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d700c-052c-4c67-b0c8-fc6a537bc33f service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.231606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1189/2383] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:49:26.155073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.238482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd696f1-3429-4646-b119-18470457d2ff None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.244349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.245111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.245419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.245688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] PATH_INFO: `/v3/users/1c9ee4b007d9428da53466a0d97053e4` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.246985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9ee4b007d9428da53466a0d97053e4)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.249489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.481785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9ee4b007d9428da53466a0d97053e4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.483325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9ee4b007d9428da53466a0d97053e4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.494725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9ee4b007d9428da53466a0d97053e4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.499605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9ee4b007d9428da53466a0d97053e4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.519646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9ee4b007d9428da53466a0d97053e4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.571637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1195/2384] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:26 2022] DELETE /identity/v3/users/1c9ee4b007d9428da53466a0d97053e4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:26.576808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.577398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.577557 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.613238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:26.614887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.699068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1190/2385] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:26.709243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.710825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.769325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:26.774044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6881af-300a-40d7-a2e2-77d1629b2aa2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.778562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.779784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.780090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.780711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.791061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.821261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.821261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1196/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:27.329703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:27.331416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:27.348944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139b32e-55b4-4a09-89e8-ea2361f3f59e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:27.350975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:27.351625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.351909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.352244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] PATH_INFO: `/v3/projects/ca3fbce57c02447aaace5daf33319e70` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.354399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3fbce57c02447aaace5daf33319e70)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:27.356334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:27.406999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=100 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:27.510624 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3fbce57c02447aaace5daf33319e70', 'request_id': 'req-a82942a6-26de-45ed-8157-a3d16e0e8931'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.518027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3fbce57c02447aaace5daf33319e70', 'request_id': 'req-a82942a6-26de-45ed-8157-a3d16e0e8931'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.526555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3fbce57c02447aaace5daf33319e70', 'request_id': 'req-a82942a6-26de-45ed-8157-a3d16e0e8931'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.582918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] The token cache is being invalidate because project ca3fbce57c02447aaace5daf33319e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:27.583565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.584000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a82942a6-26de-45ed-8157-a3d16e0e8931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.585855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1191/2387] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:27 2022] DELETE /identity/v3/projects/ca3fbce57c02447aaace5daf33319e70 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:35.766235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.767627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.837595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0a093-bee0-49d5-98f8-9179a24f72f6 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.898066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.898671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.898953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.899221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.900964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.913752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.915356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b8f87-e657-4d2f-8f08-220ec08128fb service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.925383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1197/2388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:37.578064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.259367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.259669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.259947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.261342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1192/2389] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:49:38.267111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832a6e-44c3-435a-8ec6-41fab71521bb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.267591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832a6e-44c3-435a-8ec6-41fab71521bb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.267691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832a6e-44c3-435a-8ec6-41fab71521bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.287961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-fb832a6e-44c3-435a-8ec6-41fab71521bb None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:38.289143 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fb832a6e-44c3-435a-8ec6-41fab71521bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:38.373880 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1198/2390] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:38.385667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:38.392344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:38.447839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081757d-0030-4a2b-a70e-556ddbf2f9be None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:38.451946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:38.452573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.452856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.453132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.463318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:38.464772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065be370-0c9d-4e5b-a511-7ff0c237ffeb service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:38.476438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1193/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:38.639267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.639569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.639840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.641269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1199/2392] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:49:38.646056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a612-ff3c-4c84-9903-a4f9dbb8072d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.646533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a612-ff3c-4c84-9903-a4f9dbb8072d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.646649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a612-ff3c-4c84-9903-a4f9dbb8072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.666154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-de05a612-ff3c-4c84-9903-a4f9dbb8072d None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:38.667381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-de05a612-ff3c-4c84-9903-a4f9dbb8072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:38.719367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1194/2393] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:38.731122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:38.733300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:38.746374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4415e5-82ff-4cdc-beab-271c1dc08cd9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:38.750830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:38.751414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.751694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.751999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.759048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:38.760535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccb6f5-d23c-4756-8012-c6268072af18 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:38.768432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1200/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:38.849754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b496f2-6a61-466c-ae18-39512fe26ebd None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.850078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b496f2-6a61-466c-ae18-39512fe26ebd None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.850361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b496f2-6a61-466c-ae18-39512fe26ebd None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.851776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1195/2395] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:49:38.857088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f529c6-dce8-4402-824b-44df0ea27bdb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.857375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f529c6-dce8-4402-824b-44df0ea27bdb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.857660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f529c6-dce8-4402-824b-44df0ea27bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.865924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.878312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a9f529c6-dce8-4402-824b-44df0ea27bdb None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:38.879490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a9f529c6-dce8-4402-824b-44df0ea27bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:38.888983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1201/2396] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:38.899462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b496f2-6a61-466c-ae18-39512fe26ebd None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:38.911362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b496f2-6a61-466c-ae18-39512fe26ebd None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:38.915132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:38.915731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.916007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.916281 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.927220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:38.928631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:38.939333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1196/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:42.726390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a4e4-1b15-48fd-a1eb-4b0b379079a5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:42.726890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a4e4-1b15-48fd-a1eb-4b0b379079a5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:42.727036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02a4e4-1b15-48fd-a1eb-4b0b379079a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:42.746985 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-9e02a4e4-1b15-48fd-a1eb-4b0b379079a5 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:42.748283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9e02a4e4-1b15-48fd-a1eb-4b0b379079a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:42.807887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1202/2398] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:42.822010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:42.823575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:42.895393 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2b61-d2e5-4edb-a39d-a4af498a5e81 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:42.900384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:42.900970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:42.901246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:42.901509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:42.909727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:42.911364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:42.919718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1197/2399] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:52.800714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=27 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.916119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:07.299216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:07.299216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:07.299647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:07.321579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:07.322817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:07.331475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1203/2400] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 03:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:07.344162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:07.355067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58618101-d92d-4338-a331-a2ea2d4938df service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:07.360121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:07.362793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:07.362793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:07.362793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:07.369583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:07.371282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f72a5c-ccfa-4fbd-a4e0-458c7ed9ac89 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:07.380366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1198/2401] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:11.357055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:11.358685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:11.370852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f055cf2-8e98-4936-a89f-f5b966cfd245 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:11.382377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:11.382377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:11.382377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:11.382377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:11.382922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:11.440206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:11.441650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910bc50-0f51-440e-9859-ee8ebecfc773 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:11.451093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1204/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:11.487626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df57a-5abf-4c68-b42e-9f2dd83a13fb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:11.488169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df57a-5abf-4c68-b42e-9f2dd83a13fb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:11.488169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df57a-5abf-4c68-b42e-9f2dd83a13fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:11.513207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-da5df57a-5abf-4c68-b42e-9f2dd83a13fb None None] MFA Rules not processed for user `8a3020f93df64f2aab880322ef0c4c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:11.513207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da5df57a-5abf-4c68-b42e-9f2dd83a13fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:11.566203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1199/2403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:21.446775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=33 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:21.558790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=31 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:56.569754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:56.570496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:56.570496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:56.589431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] MFA Rules not processed for user `8947c9cf75d642c88f1dc2f4382025bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:56.590665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:56.646301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1205/2404] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:06.639039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=25 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:27.496012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.496012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.496012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.512449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] MFA Rules not processed for user `4428117ca9564d6db9a638c888127223`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:27.513665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:27.570189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1200/2405] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:51:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:27.805341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:27.814919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fdfab-3d63-4397-b493-d0853c55baf1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.818523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.819115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.819396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.819672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.821401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:27.834456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.835873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.846647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1206/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:29.320337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:29.330138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591d51e-0443-46c1-8a9c-b1d7888dc5f4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:29.333576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:29.334199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:29.334477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:29.334747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:29.336434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:29.350310 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:29.351716 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:29.363628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1201/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:37.841871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=6 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:39.357712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=31 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:39.925085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:39.926518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:39.940021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb8e0d-cd16-49fe-a239-e511cd78eb25 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:39.945737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:39.946301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:39.946583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:39.946853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:39.948528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:39.959734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:39.961302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:39.970217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1207/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:49.966217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=6 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:01.653803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:01.655847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:01.675860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9541f4-b169-497f-9e6c-6709bababfcb service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:01.681581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:01.682301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:01.682726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:01.683070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:01.684924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:01.697654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:01.699311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bdc4a-08a4-4662-bcce-f254daae37ad service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:01.710844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1202/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:08.165204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:08.171432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:08.220904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38039e-ba97-40c6-bc33-18e777c42f62 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:08.224966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:08.225552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:08.225829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:08.226125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:08.227823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:08.238292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:08.240360 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:08.249165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1208/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:11.706319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.245089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=26 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:18.615864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:18.616369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:18.616493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:18.636948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] MFA Rules not processed for user `8a3020f93df64f2aab880322ef0c4c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:18.638263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:18.646286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1203/2411] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:18.948289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:18.959154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc79e2f-b2df-4015-8d89-4a5016ca6762 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:18.962940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:18.963530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:18.963882 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:18.964151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:18.965995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:18.975791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:18.977214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:18.985134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1209/2412] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:19.446403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:19.451638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:19.468895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f007-1fce-4b27-ac6b-c83a0cca261f None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:19.476478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:19.477193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:19.477539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:19.477882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:19.482263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:19.502852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:19.504565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:19.515773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1204/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:23.193694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:23.202421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc1679-353d-4774-9bea-d0f9bb6003f0 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:23.206144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:23.206733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:23.207009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:23.207279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:23.209028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:23.218581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:23.219995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:23.227924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1210/2414] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:24.526638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:24.546774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076535-09b8-4b7f-b760-d860c017cee8 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:24.558539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:24.560698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:24.561383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:24.562446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:24.564370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:24.579717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:24.583261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:24.594766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1205/2415] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:30.639119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:30.653302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c872-36f3-4b27-9c6e-5c548f1dc952 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:30.658843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:30.659445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:30.659723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:30.659995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:30.661812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:30.675815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:30.677837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:30.689169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1211/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:33.940469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:33.952104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db814ecf-d681-46af-9696-93dacd7294f0 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:33.955695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:33.956296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:33.956577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:33.956854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:33.958614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:34.025572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:34.027036 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:34.036825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1206/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:38.447672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:38.449137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:38.464175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d19-73d8-486b-84bf-ab77f8feae0e service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:38.469139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:38.469728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:38.470032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:38.470305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:38.471999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:38.483741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:38.485315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:38.495299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1212/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:38.557294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:38.559396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:38.574737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ac763-2fbf-4e2c-a4ab-05cda7740cf9 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:38.579792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:38.580422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:38.580706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:38.580981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] PATH_INFO: `/v3/users/8947c9cf75d642c88f1dc2f4382025bb` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:38.582146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8947c9cf75d642c88f1dc2f4382025bb)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:38.584068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:38.763660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8947c9cf75d642c88f1dc2f4382025bb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:38.770554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8947c9cf75d642c88f1dc2f4382025bb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:38.771238 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8947c9cf75d642c88f1dc2f4382025bb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:38.771852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8947c9cf75d642c88f1dc2f4382025bb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:38.818590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2929ae20-655d-435d-8bee-51d6e94845f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8947c9cf75d642c88f1dc2f4382025bb'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:38.837175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1207/2419] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:52:38 2022] DELETE /identity/v3/users/8947c9cf75d642c88f1dc2f4382025bb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:39.089397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.106000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279e3a1-97ff-4531-b845-9ba806ab4149 service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.165083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.165707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.166021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.166299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] PATH_INFO: `/v3/projects/17808c40ec1c41e5b0f5d8271826f7e9` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.167411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17808c40ec1c41e5b0f5d8271826f7e9)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.169311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.302672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17808c40ec1c41e5b0f5d8271826f7e9', 'request_id': 'req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:39.383599 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17808c40ec1c41e5b0f5d8271826f7e9', 'request_id': 'req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:39.390239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17808c40ec1c41e5b0f5d8271826f7e9', 'request_id': 'req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:39.401187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] The token cache is being invalidate because project 17808c40ec1c41e5b0f5d8271826f7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:52:39.401475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:39.402144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c8a40671-b5e5-4f75-ae31-96ab9cef6ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:52:39.403656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1213/2420] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:52:39 2022] DELETE /identity/v3/projects/17808c40ec1c41e5b0f5d8271826f7e9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:39.408547 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.408930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.409215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.428587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:39.429771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:39.460970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.490921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1208/2421] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:39.498778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.499294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.499393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.519434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:39.523873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:39.529272 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1214/2422] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:39.533471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.543067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594b089-1563-4735-b2d3-3d8f49bdfac4 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.547731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.548373 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.548865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.549294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.550272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:52:39.550581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.552177 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.564526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1209/2423] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:52:39.569296 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.578500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc253b7-025a-4366-b5d3-141c0a192de9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.583101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.583689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.583969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.584329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.585465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.587403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.677106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1215/2424] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:52:39 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:52:39.681793 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.691748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b09f9-3a0c-4468-8488-04fe574051cd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.747879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.748574 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.748857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.749131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.749758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.751710 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.819477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1210/2425] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:52:39 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:52:39.823433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.834043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b10798-b72b-42b0-b107-2f5a5c36541c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.838744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.839329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.839607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.839877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.840518 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.842182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.844242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.852426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1216/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:52:39.856184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.866619 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff95cc-6396-4fa7-82fa-517288932a8e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.871273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.871858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.872136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.872407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.873041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.874665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ea95-b838-459e-abc7-e6883497f806 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:39.886264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1211/2427] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:52:39.890342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:39.900274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5e980-1be5-4aeb-9b80-0c184bb7aee0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:39.905442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:39.906140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:39.910057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:39.910057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] PATH_INFO: `/v3/projects/20fc70cc672347dc83dda154b3f75d51/users/a9722fb4f9d24b15b6f33ef1fc0550f6/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:39.921031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fc70cc672347dc83dda154b3f75d51, user_id=a9722fb4f9d24b15b6f33ef1fc0550f6, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:39.923710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:40.016937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1217/2428] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:52:39 2022] PUT /identity/v3/projects/20fc70cc672347dc83dda154b3f75d51/users/a9722fb4f9d24b15b6f33ef1fc0550f6/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:52:40.034474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b55d-0cfe-480c-ac11-8fbb3db478f6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:40.034758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b55d-0cfe-480c-ac11-8fbb3db478f6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:40.035035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1b55d-0cfe-480c-ac11-8fbb3db478f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:40.055199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-01c1b55d-0cfe-480c-ac11-8fbb3db478f6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:40.056387 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-01c1b55d-0cfe-480c-ac11-8fbb3db478f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:40.113718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1212/2429] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:40.123888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:40.125708 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:40.183031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f912-a9c2-4177-a6f1-709ad871abd2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:40.186614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:40.187339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:40.187627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:40.187904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:40.197105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:40.198642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:40.208030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1218/2430] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:45.227519 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380d33-7215-459b-ba72-05161dbef52e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:45.228046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380d33-7215-459b-ba72-05161dbef52e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:45.228222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380d33-7215-459b-ba72-05161dbef52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:45.260769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-29380d33-7215-459b-ba72-05161dbef52e None None] MFA Rules not processed for user `a9722fb4f9d24b15b6f33ef1fc0550f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:45.262134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-29380d33-7215-459b-ba72-05161dbef52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:45.294334 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:45.332621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1213/2431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:45.362112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:45.363549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:45.445615 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a84815-1e59-40b6-8c7b-4049ad3396d4 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:45.451274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:45.451890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:45.452169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:45.452444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:45.461558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:45.463282 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:45.472713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1219/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:47.735234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11461-69fb-4f74-ad60-4e4df10173d2 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:47.735766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11461-69fb-4f74-ad60-4e4df10173d2 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:47.735873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d11461-69fb-4f74-ad60-4e4df10173d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:47.756181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-60d11461-69fb-4f74-ad60-4e4df10173d2 None None] MFA Rules not processed for user `a9722fb4f9d24b15b6f33ef1fc0550f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:47.757497 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-60d11461-69fb-4f74-ad60-4e4df10173d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:47.767364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1214/2433] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:52:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:48.108999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:48.110531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:48.123645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41ce2-44d3-4709-81fc-7f300cbc074f service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:48.127312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:48.127972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:48.128249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:48.128519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:48.130609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:48.142266 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:48.143673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:48.153415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1220/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:57.750589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=17 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:58.149404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:22.965473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358436-7155-4c90-b646-46ddb62c763f None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:22.965999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358436-7155-4c90-b646-46ddb62c763f None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:22.966100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358436-7155-4c90-b646-46ddb62c763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:22.985222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c9358436-7155-4c90-b646-46ddb62c763f None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:22.986465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c9358436-7155-4c90-b646-46ddb62c763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:23.044096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1215/2435] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:53:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:23.218160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:23.219618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:23.290376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3903c0a-73f9-438a-8c37-cfa4ba663658 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:23.295526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:23.296150 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:23.296432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:23.296706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:23.304791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:23.307037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c76ac-ac93-4db9-9311-9ecc3f67de3a service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:23.315037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1221/2436] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:53:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:33.037121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=25 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:33.311883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=32 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:40.447030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.447618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.447618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.448992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1216/2437] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:53:40.454791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed17-6ca9-4bac-9d02-7242837f7953 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.455216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed17-6ca9-4bac-9d02-7242837f7953 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.455379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed17-6ca9-4bac-9d02-7242837f7953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.475103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c60aed17-6ca9-4bac-9d02-7242837f7953 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:40.476315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c60aed17-6ca9-4bac-9d02-7242837f7953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.485675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1222/2438] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:40.497614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:40.499441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.558960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1928c9-5096-4fad-8ad3-39390f54e1b5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:40.562473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:40.563063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.563339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.563607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.574056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:40.575463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e0beb-ee7e-459d-b642-f0e542e03699 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:40.585986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1217/2439] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:40.780759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2aa2f-6db4-4e6e-bd8b-183b99a6890a None None] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.781052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2aa2f-6db4-4e6e-bd8b-183b99a6890a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.781366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2aa2f-6db4-4e6e-bd8b-183b99a6890a None None] PATH_INFO: `/` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.782761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1223/2440] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:53:40.787350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c7b81-40dc-47d3-9f32-d13888d1e00e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.787636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c7b81-40dc-47d3-9f32-d13888d1e00e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.787918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c7b81-40dc-47d3-9f32-d13888d1e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.808045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-926c7b81-40dc-47d3-9f32-d13888d1e00e None None] MFA Rules not processed for user `b4a8cbc422f14bd2b284402085ca7050`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:40.809246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-926c7b81-40dc-47d3-9f32-d13888d1e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.815889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1218/2441] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:40.828214 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2aa2f-6db4-4e6e-bd8b-183b99a6890a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:40.839286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2aa2f-6db4-4e6e-bd8b-183b99a6890a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:40.842851 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:40.843442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.843721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.843994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.851287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:40.853725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9727b42-1b28-469d-a476-cf17992d2a2d service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:40.862459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1224/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:40.947537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdce9-6557-49b7-a0fd-3d807591febc None None] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.947825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdce9-6557-49b7-a0fd-3d807591febc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.948107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebdce9-6557-49b7-a0fd-3d807591febc None None] PATH_INFO: `/` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.949646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1219/2443] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 24 03:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:53:40.954852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe28-fca6-435e-a478-5fe4063c8da4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.955134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe28-fca6-435e-a478-5fe4063c8da4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.955407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191fe28-fca6-435e-a478-5fe4063c8da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.974621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-5191fe28-fca6-435e-a478-5fe4063c8da4 None None] MFA Rules not processed for user `39cdc5dd5bdc44379c4504de359775c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:40.975817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5191fe28-fca6-435e-a478-5fe4063c8da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.985012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1225/2444] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 24 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:40.995861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebdce9-6557-49b7-a0fd-3d807591febc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:41.006729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebdce9-6557-49b7-a0fd-3d807591febc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:41.011090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:41.011678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:41.011982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:41.012256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:41.023260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:41.024687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:41.035422 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1220/2445] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:43.297754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:43.298243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:43.298335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:43.322119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:43.323328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:43.330541 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1226/2446] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:43.342316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:43.353960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7043b7-c34d-4f03-9fee-787b11492372 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:43.359198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:43.359822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:43.360101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:43.360377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:43.369107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:43.370758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1509a-26a1-49c4-9a1c-7bfb8f28cb45 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:43.378762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1221/2447] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:53.316757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=15 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:53.375551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=41 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:02.370699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:02.383539 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382be51-326d-4ca5-aaae-81199b317b84 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:02.388945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:02.389791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:02.390113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:02.390418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:02.392173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:02.449665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:02.451294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:02.460186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1227/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:06.321555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b22d-868b-428c-8b52-fcc52623f9c6 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:06.322074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b22d-868b-428c-8b52-fcc52623f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:06.322185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09b22d-868b-428c-8b52-fcc52623f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:06.342018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ac09b22d-868b-428c-8b52-fcc52623f9c6 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:06.343207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ac09b22d-868b-428c-8b52-fcc52623f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:06.350179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1222/2449] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 03:54:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:06.362766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:06.374657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1687-c778-4375-972a-57c099bdd4d4 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:06.379671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:06.380293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:06.380572 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:06.380844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:06.388876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:06.390823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:06.398977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1228/2450] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 03:54:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:54:16.337250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:16.395761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=34 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:19.865010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:19.865533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:19.865533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:19.894316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] MFA Rules not processed for user `8a3020f93df64f2aab880322ef0c4c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:19.895508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:19.919458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1223/2451] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:54:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:29.916869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=15 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:10.221399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:10.223005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:10.387776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e72f0-6276-460a-8a65-b213bf1f8c01 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:10.393801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:10.394710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:10.394990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:10.395264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:10.397188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:10.409761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:10.411755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:10.422602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1229/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:12.268262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:12.289361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ed9cb-f4b8-4c63-a500-d6c7c0b775a7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:12.294140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:12.294752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:12.295026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:12.295293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:12.297217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:12.374380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:12.375866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:12.387445 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1224/2453] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:15.165783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:15.176527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328da4c-2777-4f06-8477-770a5b0e8161 service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:15.180397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:15.181002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:15.181431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:15.181691 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:15.183658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:15.220496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:15.221956 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:15.246907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1230/2454] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:18.986097 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.001329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6ba1-6a40-471f-b364-ea25d0813d40 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.010529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.011562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.012089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.012563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.014715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.028454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.029925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.050805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1225/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:19.555348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.567424 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3760933-4107-4473-b713-4d6bb7ea5051 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.574243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.575154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.575427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.575697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.577519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.593072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.595260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.605924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1231/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:19.690113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:19.692209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:19.705298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6c0a-d3bf-44b3-890d-0bfa61da18f9 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:19.710614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:19.710776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:19.711079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:19.711554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] PATH_INFO: `/v3/users/4428117ca9564d6db9a638c888127223` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:19.712684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4428117ca9564d6db9a638c888127223)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:19.714655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:19.880489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4428117ca9564d6db9a638c888127223'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.887388 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4428117ca9564d6db9a638c888127223'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.888071 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4428117ca9564d6db9a638c888127223'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.888707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4428117ca9564d6db9a638c888127223'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.957410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2fe3bcaa-af08-493b-a6e3-13f3b93d3bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4428117ca9564d6db9a638c888127223'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:19.976010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1226/2457] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:19 2022] DELETE /identity/v3/users/4428117ca9564d6db9a638c888127223 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:20.461350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:20.472357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc821b-3e5e-4802-9f1e-9927d75d98f5 service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:20.508730 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.533315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:20.534019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:20.534318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:20.534594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] PATH_INFO: `/v3/projects/2e04720617934fdb873bef90a0b10979` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:20.535718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e04720617934fdb873bef90a0b10979)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:20.537690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:20.655739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e04720617934fdb873bef90a0b10979', 'request_id': 'req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.714334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e04720617934fdb873bef90a0b10979', 'request_id': 'req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.725080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e04720617934fdb873bef90a0b10979', 'request_id': 'req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.742920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] The token cache is being invalidate because project 2e04720617934fdb873bef90a0b10979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:20.747264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.747264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2bf44fa2-91a6-4720-a9a5-eafe5ee859e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:20.748253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1232/2458] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:20 2022] DELETE /identity/v3/projects/2e04720617934fdb873bef90a0b10979 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:20.754108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:20.754598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:20.754861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:20.825984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:20.827356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:20.844503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:20.900405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1227/2459] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:20.910158 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:20.910522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:20.910869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:20.931431 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:20.932690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:20.940782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1233/2460] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:20.945214 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:20.955119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1632b-4b08-45e3-9753-53a659a3bd71 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:20.959816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:20.960410 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:20.960690 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:20.960961 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:20.961631 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:20.961930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:20.963531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:20.981896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1228/2461] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:55:20.983137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:20.993852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a20c41-a51f-4dac-96dd-5733b9a3625a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:20.998947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:20.999656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.000051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.000455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.001179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.003443 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.103785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1234/2462] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:20 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:21.105413 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:21.118722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d91d0-ad14-4501-a681-2626f62f2dc0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:21.208021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:21.208634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.208913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.209186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.209843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.213136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.310896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1229/2463] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:21 2022] POST /identity/v3/users => generated 284 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:21.315033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:21.325248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efcf58-40b8-4593-8dd6-63b4ea2609c3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:21.330359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:21.331452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.331452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.331644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.332149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.333776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.343475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1235/2464] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:21.347830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:21.357756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d3b0-cf16-4e02-800b-b018a4f116d1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:21.363051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:21.363249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.363377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.363652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.364326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.365951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccbcf1-716b-48ee-8005-e3b55b029a7a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.376561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1230/2465] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:21.380843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:21.391388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbb1ae-3907-4888-922d-66cd0d7c6ee7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:21.396336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:21.396977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.397260 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.397531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] PATH_INFO: `/v3/projects/d36d1acd03df4ff480e2648b1e53044e/users/3b37ab8126e8405f991ff8508729dd6b/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.413281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36d1acd03df4ff480e2648b1e53044e, user_id=3b37ab8126e8405f991ff8508729dd6b, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.415976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.508817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1236/2466] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:21 2022] PUT /identity/v3/projects/d36d1acd03df4ff480e2648b1e53044e/users/3b37ab8126e8405f991ff8508729dd6b/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:21.523191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.523588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.523785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.554861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] MFA Rules not processed for user `3b37ab8126e8405f991ff8508729dd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:21.556370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:21.631266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1231/2467] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:21.643101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:21.645052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:21.718779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:21.727748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710bf83-bb77-4935-8b51-9d004974ff3a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:21.731484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:21.732086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:21.732378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:21.732639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:21.741352 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:21.742841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:21.752745 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1237/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:26.364489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:26.365978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:26.382197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:26.433654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324a092-c1fa-4b73-8d96-42d3432a41de None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:26.438953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:26.441576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:26.441576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:26.441576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] PATH_INFO: `/v3/users/fa3c27c566e543efa50013e5adf19fcd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:26.441576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3c27c566e543efa50013e5adf19fcd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:26.443151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:26.613039 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3c27c566e543efa50013e5adf19fcd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:26.621209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3c27c566e543efa50013e5adf19fcd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:26.621946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3c27c566e543efa50013e5adf19fcd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:26.622601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3c27c566e543efa50013e5adf19fcd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:26.705068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3c27c566e543efa50013e5adf19fcd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:26.719829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1232/2469] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:26 2022] DELETE /identity/v3/users/fa3c27c566e543efa50013e5adf19fcd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:26.960029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:26.981310 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbd0f-790e-46c7-9a7f-ed7bdb5024e5 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:27.041576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:27.042332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:27.042696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:27.043030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] PATH_INFO: `/v3/projects/7b6487bf78f349daa3d33053b1c48a0c` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:27.044157 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6487bf78f349daa3d33053b1c48a0c)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:27.046129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:27.143205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6487bf78f349daa3d33053b1c48a0c', 'request_id': 'req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.203530 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6487bf78f349daa3d33053b1c48a0c', 'request_id': 'req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.210944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6487bf78f349daa3d33053b1c48a0c', 'request_id': 'req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.222354 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] The token cache is being invalidate because project 7b6487bf78f349daa3d33053b1c48a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:27.224058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.224058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.224794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1238/2470] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:26 2022] DELETE /identity/v3/projects/7b6487bf78f349daa3d33053b1c48a0c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:27.228774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:27.232323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:27.245561 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597619cf-e221-449f-a1e8-3bf31673dbb8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:27.308101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:27.308744 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:27.309031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:27.309314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] PATH_INFO: `/v3/users/dab7ddd214674cb3ad7d67a98ef0cc92` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:27.310486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab7ddd214674cb3ad7d67a98ef0cc92)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:27.312427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:27.488339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:27.497471 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab7ddd214674cb3ad7d67a98ef0cc92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.504554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab7ddd214674cb3ad7d67a98ef0cc92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.505409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab7ddd214674cb3ad7d67a98ef0cc92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.506058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab7ddd214674cb3ad7d67a98ef0cc92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.591885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab7ddd214674cb3ad7d67a98ef0cc92'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:27.610256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1233/2471] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:27 2022] DELETE /identity/v3/users/dab7ddd214674cb3ad7d67a98ef0cc92 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:27.873324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:27.873568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:27.887610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd6f8-5d80-477d-bd1c-5b091fabb8ee admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:27.952989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:27.953923 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:27.954248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:27.954524 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] PATH_INFO: `/v3/projects/62f3d15c576e41ae95294725c713dd47` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:27.955712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f3d15c576e41ae95294725c713dd47)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:27.957616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:27.974316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:28.083494 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f3d15c576e41ae95294725c713dd47', 'request_id': 'req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:28.128627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f3d15c576e41ae95294725c713dd47', 'request_id': 'req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:28.135187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f3d15c576e41ae95294725c713dd47', 'request_id': 'req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:28.146146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] The token cache is being invalidate because project 62f3d15c576e41ae95294725c713dd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:28.146437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:28.147070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-1a26baa0-bd18-49d7-adc8-9a0c7a4ae645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:28.148566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1239/2472] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:27 2022] DELETE /identity/v3/projects/62f3d15c576e41ae95294725c713dd47 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:31.618418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:31.619819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:31.633160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d8e4-1ff6-45c6-8448-5b41cf21cb0a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:31.691814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:31.692454 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:31.692735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:31.693018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] PATH_INFO: `/v3/users/3b37ab8126e8405f991ff8508729dd6b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:31.694175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b37ab8126e8405f991ff8508729dd6b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:31.696098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:31.891784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b37ab8126e8405f991ff8508729dd6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:31.898940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b37ab8126e8405f991ff8508729dd6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:31.899608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b37ab8126e8405f991ff8508729dd6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:31.900222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b37ab8126e8405f991ff8508729dd6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:31.951777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b37ab8126e8405f991ff8508729dd6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:31.969219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1234/2473] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:31 2022] DELETE /identity/v3/users/3b37ab8126e8405f991ff8508729dd6b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:31.973653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:31.974170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:31.974292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:31.993247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:31.994489 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.053409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1240/2474] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:32.063145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.064620 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.099763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.133978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca234924-dd3d-4784-8980-ca711487b348 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.138137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.138743 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.139019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.139288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.148451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.149824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd450-2fcd-4ded-9bf4-0f3cbd0bc9bd service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:32.159158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1235/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:32.564811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.567588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.579495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b6bc-e2f3-4a00-b3fd-b0b1a906c055 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.584829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.585513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.585796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.586110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] PATH_INFO: `/v3/projects/d36d1acd03df4ff480e2648b1e53044e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.587349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36d1acd03df4ff480e2648b1e53044e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.589270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:32.715019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36d1acd03df4ff480e2648b1e53044e', 'request_id': 'req-7648ff05-8790-4ea6-986a-5d43c79e3eb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.784634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36d1acd03df4ff480e2648b1e53044e', 'request_id': 'req-7648ff05-8790-4ea6-986a-5d43c79e3eb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.791677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36d1acd03df4ff480e2648b1e53044e', 'request_id': 'req-7648ff05-8790-4ea6-986a-5d43c79e3eb0'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.802252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] The token cache is being invalidate because project d36d1acd03df4ff480e2648b1e53044e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:32.802536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.803165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7648ff05-8790-4ea6-986a-5d43c79e3eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:32.804650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1241/2476] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:32 2022] DELETE /identity/v3/projects/d36d1acd03df4ff480e2648b1e53044e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:32.809715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.810223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.810340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.830030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:32.831222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.888819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1236/2477] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:32.898305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.898596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.898875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.918705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:32.919906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:32.928432 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1242/2478] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:32.933006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.943833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49d72-64cb-4b03-9d12-79b5edffdd20 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.948958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.949494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.949771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.950076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.950720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:32.951018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.952628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:32.964221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1237/2479] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:32.969096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:32.978964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9552ff-90b1-47a1-ad58-ff1cdb1bbd60 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:32.983673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:32.984255 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:32.984535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:32.984804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:32.985420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:32.987385 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.068025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:33.074470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1243/2480] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:32 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:33.078927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.089263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187348b-1cb4-4406-9b96-9d07924a29be admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.146973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.147580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.147865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.148141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.148770 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.150737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.220797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1238/2481] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:33 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:33.234537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.245013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4372b-e54a-40f7-9fab-08bfc42cd50c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.249662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.250280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.250555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.254860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.254860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.254860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.263251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1244/2482] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:33.267107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.278037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554542f-d9c2-4eac-9172-6898476ac79c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.282682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.283271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.283551 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.283824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.285126 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.286853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39285a85-e236-4d69-b84e-fae905f74a46 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.297400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1239/2483] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:33.301367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.311362 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df6a91-701c-49f9-a06e-7ddab4f7b8de admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.316045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.319258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.319258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.319258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] PATH_INFO: `/v3/projects/5102bceeb9ab42c3ae256eee9a987bbd/users/0891acb691184c1a99ea25524a99cdfd/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.331968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5102bceeb9ab42c3ae256eee9a987bbd, user_id=0891acb691184c1a99ea25524a99cdfd, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.334733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.403339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1245/2484] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:33 2022] PUT /identity/v3/projects/5102bceeb9ab42c3ae256eee9a987bbd/users/0891acb691184c1a99ea25524a99cdfd/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:33.418892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.419180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.419455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.446314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] MFA Rules not processed for user `0891acb691184c1a99ea25524a99cdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:33.447517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:33.464343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:33.512241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1240/2485] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:33.516709 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.578403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f89c-f9ae-4458-bf0c-33c9234f9c03 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.583846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.584444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.584723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.584995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.585610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.587607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.685496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1246/2486] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:33 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:33.689570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.701062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdcaca-7030-494a-a2c4-654839042771 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.759049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.759649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.759927 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.760199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.760825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.762900 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.838434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1241/2487] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:33 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:33.842623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.853165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc9db-bed3-4233-b743-561d79f39dda admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.857892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.858517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.858795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.859208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.859890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.861484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.872871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1247/2488] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:33.876917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.887152 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d9f1-ea49-4396-bb10-8cafb925bfab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:33.891732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:33.892370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:33.892651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:33.892924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] PATH_INFO: `/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522/users/b8e08f4cde78461aad79bd1ce48e84f4/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:33.908007 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03263f1beebb4f3db9b3b0fbbc8ae522, user_id=b8e08f4cde78461aad79bd1ce48e84f4, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:33.910705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:33.980193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1242/2489] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:33 2022] PUT /identity/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522/users/b8e08f4cde78461aad79bd1ce48e84f4/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:33.984129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:33.995001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e4e7c-0433-494d-9a32-8776fc39cc4d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.050718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.051245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.051522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.051815 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.052448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.054057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966026-1b7b-4b8d-91f2-56e0740a41c3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.063710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1248/2490] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:34.068461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:34.078764 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa53b-5c8c-4aa3-97aa-39b688f4f884 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.083415 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.084048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.084330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.084603 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] PATH_INFO: `/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522/users/b8e08f4cde78461aad79bd1ce48e84f4/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.086541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03263f1beebb4f3db9b3b0fbbc8ae522, user_id=b8e08f4cde78461aad79bd1ce48e84f4, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.089183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.099526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1243/2491] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:34 2022] PUT /identity/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522/users/b8e08f4cde78461aad79bd1ce48e84f4/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:34.109586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.109875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.110210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.138124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] MFA Rules not processed for user `b8e08f4cde78461aad79bd1ce48e84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:34.139701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.162729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.206638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1249/2492] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:34.217386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:34.219178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:34.280233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2026e96-8a3f-4d43-9756-a761bbf79217 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:34.284041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:34.285224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:34.285540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:34.285757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:34.311102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.342135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:34.343577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:34.353033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1244/2493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:37.417658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:37.427201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc5370-e8ce-44bc-9084-a088201226db None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:37.430697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:37.431294 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:37.431562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:37.431828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:37.440510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:37.441922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99cd27-80bd-451b-a4c5-2a27a4801beb service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:37.451595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1250/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:44.363865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=16 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:47.447568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=24 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.017119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.090181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8958ed-c9a6-4775-85eb-9fc0e5ceedee service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.095959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.096590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.096874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.097153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] PATH_INFO: `/v3/users/0891acb691184c1a99ea25524a99cdfd` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.098314 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0891acb691184c1a99ea25524a99cdfd)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.100240 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.285221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0891acb691184c1a99ea25524a99cdfd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.292331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0891acb691184c1a99ea25524a99cdfd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.293155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0891acb691184c1a99ea25524a99cdfd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.293650 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0891acb691184c1a99ea25524a99cdfd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.345582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0891acb691184c1a99ea25524a99cdfd'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:52.364545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1245/2495] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:52 2022] DELETE /identity/v3/users/0891acb691184c1a99ea25524a99cdfd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:52.369080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.369590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.369687 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.391631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:52.392861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.456409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1251/2496] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:52.466290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.467845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.526355 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d22f67-1ac4-4a6f-ab71-f054f40381dd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.530207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.530812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.531089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.531370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.540436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.542427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:52.551668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1246/2497] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:55:52.953014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:52.954520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:52.966828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682a07-71a0-4dac-875c-a42b9556e0f4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:52.974475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:52.974475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:52.974475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:52.974475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] PATH_INFO: `/v3/projects/5102bceeb9ab42c3ae256eee9a987bbd` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:52.974856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5102bceeb9ab42c3ae256eee9a987bbd)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:52.975920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.069087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5102bceeb9ab42c3ae256eee9a987bbd', 'request_id': 'req-2d830020-073a-45f8-875a-1474c03e1a5a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.147116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5102bceeb9ab42c3ae256eee9a987bbd', 'request_id': 'req-2d830020-073a-45f8-875a-1474c03e1a5a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.153619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5102bceeb9ab42c3ae256eee9a987bbd', 'request_id': 'req-2d830020-073a-45f8-875a-1474c03e1a5a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.164638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] The token cache is being invalidate because project 5102bceeb9ab42c3ae256eee9a987bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:53.164922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.165544 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.167058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1252/2498] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:52 2022] DELETE /identity/v3/projects/5102bceeb9ab42c3ae256eee9a987bbd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:53.171848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:53.181659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f410ca-dac0-40d7-90fe-fd74e2275dd2 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:53.199811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:53.242107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:53.242107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:53.242107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:53.242107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] PATH_INFO: `/v3/users/b8e08f4cde78461aad79bd1ce48e84f4` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:53.242483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e08f4cde78461aad79bd1ce48e84f4)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:53.244249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:53.440855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e08f4cde78461aad79bd1ce48e84f4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.447989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e08f4cde78461aad79bd1ce48e84f4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.448662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e08f4cde78461aad79bd1ce48e84f4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.449307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e08f4cde78461aad79bd1ce48e84f4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.539496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b308a45a-76d6-47bd-a508-b6f576fa8027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e08f4cde78461aad79bd1ce48e84f4'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:53.557235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1247/2499] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:55:53 2022] DELETE /identity/v3/users/b8e08f4cde78461aad79bd1ce48e84f4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:54.139594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.139594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.155269 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830020-073a-45f8-875a-1474c03e1a5a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.211480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.212105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.212380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.212652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] PATH_INFO: `/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.213760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03263f1beebb4f3db9b3b0fbbc8ae522)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.215701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.320800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:54.337326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03263f1beebb4f3db9b3b0fbbc8ae522', 'request_id': 'req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.443654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03263f1beebb4f3db9b3b0fbbc8ae522', 'request_id': 'req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.461414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03263f1beebb4f3db9b3b0fbbc8ae522', 'request_id': 'req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.461743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] The token cache is being invalidate because project 03263f1beebb4f3db9b3b0fbbc8ae522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:55:54.461990 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.462642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8fd717e1-2cc0-4f1b-b8a5-95dc479ad53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:55:54.464446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1253/2500] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:55:54 2022] DELETE /identity/v3/projects/03263f1beebb4f3db9b3b0fbbc8ae522 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:54.469340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.469725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.469902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.490459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:54.491691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.556808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1248/2501] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:54.565170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.565465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.565765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.585828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:54.587220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:54.596695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1254/2502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:54.600043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.610905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82432ef-a986-42d6-a9c1-4b3b46ab9400 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.615708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.618765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.618765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.618765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.618765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:55:54.618765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.619647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.632113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1249/2503] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:55:54.636592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.646442 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d1f10-b3fe-4991-ab25-aef6350a5efb None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.651509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.652092 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.652366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.652633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.653247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.655364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.783902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1255/2504] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:54.788267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.799185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee982-92f1-416f-8a3b-2c3ae7cde8f4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.828114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:54.861480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.862122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.862404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.862674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.863302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.865264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:54.971604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1250/2505] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:54 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:54.975499 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:54.986587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8276-a6b5-4e02-b909-83086457fa54 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:54.991258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:54.991846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:54.992123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:54.992395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:54.993038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:54.994665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.004907 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1256/2506] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:55.008844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.019496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa568-ee16-454f-9106-797554543df8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.024306 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.024914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.025191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.025462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.026215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.028361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c3b4c-9823-4f77-93f2-cfa12a1d51a2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.040259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1251/2507] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:55.044321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.054533 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ef8cb-f696-4b70-bd01-ee2f94cd7f62 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.059137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.059781 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.060061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.060334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] PATH_INFO: `/v3/projects/e7ace60811d344c282d1c5e9a35992f9/users/8d3fd956ac2b49c99381d3c12e3a5939/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.074723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ace60811d344c282d1c5e9a35992f9, user_id=8d3fd956ac2b49c99381d3c12e3a5939, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.077373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.147677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1257/2508] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:55 2022] PUT /identity/v3/projects/e7ace60811d344c282d1c5e9a35992f9/users/8d3fd956ac2b49c99381d3c12e3a5939/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:55:55.158746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.159078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.159333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.186428 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] MFA Rules not processed for user `8d3fd956ac2b49c99381d3c12e3a5939`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:55.187630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.250197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1252/2509] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:55:55.254744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.318091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914afb9-a7b0-43a1-b531-5d52747d701f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.322726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.323321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.323601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.323877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.324502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.326441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.446646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1258/2510] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:55:55 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:55.450808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.462225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d0d2-faa7-47bd-9fe0-d183b1a169f0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.517426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.518088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.518319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.518591 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.519205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.521382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.622372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1253/2511] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:55:55 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:55:55.628117 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.637407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc8b7d-fbd6-461f-bc9a-8baacef08cbd admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.642778 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.643374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.643656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.643935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.644582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.646491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.657053 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1259/2512] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:55.661294 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.671473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110928-5b87-40d0-9ad1-e322c5cd23bd admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.676166 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.676816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.677100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.677376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] PATH_INFO: `/v3/projects/0747a346321e4949beeb5e8f213104a2/users/a9768c9962ac4b90a6c20b336cd69418/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.693339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0747a346321e4949beeb5e8f213104a2, user_id=a9768c9962ac4b90a6c20b336cd69418, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.696073 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.765859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1254/2513] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:55 2022] PUT /identity/v3/projects/0747a346321e4949beeb5e8f213104a2/users/a9768c9962ac4b90a6c20b336cd69418/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:55.770526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.781002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79626b2-4474-4bfe-83dd-30574cbdbee3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.801162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.839007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.839664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.839945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.840220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.840864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.842623 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f220fb0-7491-41f0-b1a4-744f7a9db565 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.852822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1260/2514] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:55:55.857178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.863423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.868784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94233-cf83-46be-bf2b-762911c8232b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.874050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.875062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.875365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.875643 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] PATH_INFO: `/v3/projects/0747a346321e4949beeb5e8f213104a2/users/a9768c9962ac4b90a6c20b336cd69418/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.877570 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0747a346321e4949beeb5e8f213104a2, user_id=a9768c9962ac4b90a6c20b336cd69418, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.880226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.890897 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1255/2515] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:55:55 2022] PUT /identity/v3/projects/0747a346321e4949beeb5e8f213104a2/users/a9768c9962ac4b90a6c20b336cd69418/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:55:55.903227 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.903513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.903787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.937931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] MFA Rules not processed for user `a9768c9962ac4b90a6c20b336cd69418`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:55.939279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.007852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1261/2516] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:56.019277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.021213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.080878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b554b-c8d9-4239-b2cb-1d2b2fe3fba0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.084523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.085121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.085411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.085677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.094749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.096174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.105507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1256/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:56.213205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:56.214801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:56.227459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fee94-c0b5-450b-964b-bdfa45a1bc39 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:56.231005 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:56.231632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:56.231912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:56.232185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:56.288729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:56.290197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3662f10-2cf4-4cf5-913e-b551035b9e13 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:56.299640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1262/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:01.392957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:01.462526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22a3b-44e3-4cc4-ad57-fb6717daf8e4 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:01.467192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:01.467899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:01.468196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:01.468481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] PATH_INFO: `/v3/users/8d3fd956ac2b49c99381d3c12e3a5939` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:01.469637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3fd956ac2b49c99381d3c12e3a5939)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:01.471813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:01.643124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3fd956ac2b49c99381d3c12e3a5939'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:01.650560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3fd956ac2b49c99381d3c12e3a5939'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:01.651263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3fd956ac2b49c99381d3c12e3a5939'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:01.651869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3fd956ac2b49c99381d3c12e3a5939'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:01.748049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3fd956ac2b49c99381d3c12e3a5939'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:01.768026 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1257/2519] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:01 2022] DELETE /identity/v3/users/8d3fd956ac2b49c99381d3c12e3a5939 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:01.772893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:01.773414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:01.773514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:01.792407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:01.793597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:01.836320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:01.854121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1263/2520] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:01.865920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:01.867472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:01.882249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:01.928884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f77a9-fb31-4405-91e3-4f948882173e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:01.932662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:01.933268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:01.933550 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:01.933835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:01.944604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:01.946249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:01.956067 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1258/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:02.465221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:02.467795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:02.493210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c216f8-d08b-403d-9a1f-25710b6cff4e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:02.504656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:02.505136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:02.505548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:02.506124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] PATH_INFO: `/v3/projects/e7ace60811d344c282d1c5e9a35992f9` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:02.510864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ace60811d344c282d1c5e9a35992f9)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:02.510864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:02.659603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ace60811d344c282d1c5e9a35992f9', 'request_id': 'req-46f2c742-6e8d-48e7-b479-7ed7459904f5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:02.731069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ace60811d344c282d1c5e9a35992f9', 'request_id': 'req-46f2c742-6e8d-48e7-b479-7ed7459904f5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:02.738014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ace60811d344c282d1c5e9a35992f9', 'request_id': 'req-46f2c742-6e8d-48e7-b479-7ed7459904f5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:02.752434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] The token cache is being invalidate because project e7ace60811d344c282d1c5e9a35992f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:02.752434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:02.752434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:02.752434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1264/2522] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:02 2022] DELETE /identity/v3/projects/e7ace60811d344c282d1c5e9a35992f9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:02.761285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:02.772353 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90ad7-dd87-4cf8-a298-bc188a20f310 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:02.840015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:02.840646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:02.840920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:02.841195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] PATH_INFO: `/v3/users/a9768c9962ac4b90a6c20b336cd69418` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:02.842341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9768c9962ac4b90a6c20b336cd69418)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:02.844251 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:03.040664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9768c9962ac4b90a6c20b336cd69418'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.049066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9768c9962ac4b90a6c20b336cd69418'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.049840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9768c9962ac4b90a6c20b336cd69418'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.050480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9768c9962ac4b90a6c20b336cd69418'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.136221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-3e104402-ade8-48de-85fd-cca01cf2d04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9768c9962ac4b90a6c20b336cd69418'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.155190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1259/2523] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:02 2022] DELETE /identity/v3/users/a9768c9962ac4b90a6c20b336cd69418 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:03.658329 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:03.659836 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:03.674154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c742-6e8d-48e7-b479-7ed7459904f5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:03.734860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:03.735506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:03.735794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:03.736080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] PATH_INFO: `/v3/projects/0747a346321e4949beeb5e8f213104a2` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:03.737216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0747a346321e4949beeb5e8f213104a2)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:03.739206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:03.879574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0747a346321e4949beeb5e8f213104a2', 'request_id': 'req-117d4c5e-70c7-4df4-b18f-27eb9f146413'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.958899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0747a346321e4949beeb5e8f213104a2', 'request_id': 'req-117d4c5e-70c7-4df4-b18f-27eb9f146413'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.965450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0747a346321e4949beeb5e8f213104a2', 'request_id': 'req-117d4c5e-70c7-4df4-b18f-27eb9f146413'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.972009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:03.976552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] The token cache is being invalidate because project 0747a346321e4949beeb5e8f213104a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:03.976839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.977488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-117d4c5e-70c7-4df4-b18f-27eb9f146413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:03.979007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1265/2524] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:03 2022] DELETE /identity/v3/projects/0747a346321e4949beeb5e8f213104a2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:03.984773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:03.985230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:03.985344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.125548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:04.127438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:04.156394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:04.185809 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1260/2525] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:04.194357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.194639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.194912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.214321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:04.215563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:04.223631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1266/2526] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:04.232053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.237732 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38daa4-5f96-4162-abc8-fa7bbb027be8 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.242460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.243048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.243326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.243599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.244252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:04.244536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.246148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.258424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1261/2527] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:04.268517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.277950 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35f94-55d0-4bac-97be-b6e155d9495f None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.282583 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.283161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.283526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.283797 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.284421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.286339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.381475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1267/2528] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:04.382713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.394461 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132b9b-0bd1-4aec-9e91-e1ed1125528a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.453192 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.453791 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.454106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.454435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.455078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.457086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.525470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1262/2529] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:04 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:04.529747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.540844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420a6b-d7bf-4d7d-9fdd-c4ede4c0c3af admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.545667 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.546323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.546794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.546925 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.547592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.549776 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.559616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1268/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:04.563518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.578266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a2d6-821b-4c41-bfb4-f3fa00b5cf6c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.578709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.579295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.579580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.579854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.580499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.582116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746556a-82f7-4edb-9a20-124e8d35e126 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.592798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1263/2531] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:04.597522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.615409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb6974-75e6-45dd-b74c-3e7b320c3784 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.619782 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.620471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.620769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.621026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] PATH_INFO: `/v3/projects/62ae79605782481388322af78e858c27/users/1bd69da6f52f45a0a02e61335d67dfac/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.638847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ae79605782481388322af78e858c27, user_id=1bd69da6f52f45a0a02e61335d67dfac, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.642311 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:04.726903 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1269/2532] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:04 2022] PUT /identity/v3/projects/62ae79605782481388322af78e858c27/users/1bd69da6f52f45a0a02e61335d67dfac/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:04.737798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.738227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.738599 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.768964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] MFA Rules not processed for user `1bd69da6f52f45a0a02e61335d67dfac`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:04.770368 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:04.842849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1264/2533] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:04.849991 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:04.926505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9eb67-9c00-421c-b899-bac991dc25a1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:04.931415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:04.932030 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:04.932307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:04.932577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:04.933242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:04.935199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.062567 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1270/2534] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:04 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:05.066654 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.077086 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe03c1-75a7-4330-a154-0cc09f66d101 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.103398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:05.134119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.134721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.134996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.135267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.135872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.137802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.249687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1265/2535] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:05 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:05.254476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.265286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e9f-f869-49a1-acee-a88e08ea417e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.270652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.271510 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.271788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.272058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.272696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.274333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.285208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1271/2536] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:05.289155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.299389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a9af3-8d7e-4382-ae66-1d1cd9eea58a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.304001 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.304587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.304905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.305184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.305828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.307460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03502aa-cc94-423a-aa56-1e6bcbb5b87f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.318511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1266/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:05.322602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.333213 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55740-6ff2-435f-94ca-37af42e9fdc9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.337754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.341434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.341434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.341434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] PATH_INFO: `/v3/projects/dde33d5ea93c41d1a41e64f32bd01e5e/users/858068fb8cfd45baaee8d4e4f2a48e51/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.353447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde33d5ea93c41d1a41e64f32bd01e5e, user_id=858068fb8cfd45baaee8d4e4f2a48e51, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.356120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.445369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1272/2538] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:05 2022] PUT /identity/v3/projects/dde33d5ea93c41d1a41e64f32bd01e5e/users/858068fb8cfd45baaee8d4e4f2a48e51/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:05.457195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.457477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.457769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.484459 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] MFA Rules not processed for user `858068fb8cfd45baaee8d4e4f2a48e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:05.485662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:05.547554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1267/2539] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:05.552459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.604453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:05.620726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9053ea-f6b7-4a49-8edf-f402b13478d9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.625608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.626242 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.626519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.626791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.627979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.629872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.720067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1273/2540] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:05 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:05.722767 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.733464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31389-c178-4539-83f8-5ad78a2f5515 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.795050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.795663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.795939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.796213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.796838 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.799279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.857970 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1268/2541] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:05 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:05.862161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.872663 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83c794-e191-416f-9249-03b7c9a672c3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.877438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.878065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.878345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.878620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.879262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.880900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.890760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1274/2542] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:05.894903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.905193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cfa11-3b41-4f65-b2f0-ae676e98c23a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.910401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.915254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.915254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.915254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] PATH_INFO: `/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be/users/ef41c1dd15df426583c455b1b60c8bf1/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.927685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cfdfbd0bfc4ed7ad0809ddb61769be, user_id=ef41c1dd15df426583c455b1b60c8bf1, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.930364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.026891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1269/2543] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:05 2022] PUT /identity/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be/users/ef41c1dd15df426583c455b1b60c8bf1/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:06.031045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.042146 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0a7b-0a21-4194-839f-7e9d8bbdc1ee admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.107628 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.108843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.109123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.109391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.110060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.112574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa3de-d7e4-44e9-b4f7-2ead588038c8 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.126291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1275/2544] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:06.128199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.135198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.145093 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e91a8-87a1-4988-96e0-fef6be2e5fb9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.146171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.146835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.147146 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.147484 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] PATH_INFO: `/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be/users/ef41c1dd15df426583c455b1b60c8bf1/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.149418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cfdfbd0bfc4ed7ad0809ddb61769be, user_id=ef41c1dd15df426583c455b1b60c8bf1, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.152120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.166135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1270/2545] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:06 2022] PUT /identity/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be/users/ef41c1dd15df426583c455b1b60c8bf1/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:06.183228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.183512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.183788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.212771 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] MFA Rules not processed for user `ef41c1dd15df426583c455b1b60c8bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:06.214008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:06.282610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1276/2546] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:06.294397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.296197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:06.352795 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048e74-b539-41da-bc63-23c166b039e1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.356385 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.356968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.357243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.357540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.366386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.367803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.377288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1271/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:06.480482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:06.481895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:06.493743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39be6-05ec-48a3-ae1b-cb67b8564394 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:06.497469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:06.503245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:06.503245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:06.503245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:06.537818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.555966 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:06.557413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:06.566808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1277/2548] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:07.397392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:07.399066 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:07.457344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d765668-1db5-432e-86b2-364d839927c1 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:07.461027 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:07.461637 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:07.461918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:07.462213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:07.463928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:07.529056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:07.530572 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c04ce-294e-4393-8e87-accdcc2355db service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:07.542232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1272/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:10.888064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.903219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abaabf-324f-4c09-bd43-29269416d133 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.909195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.913648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.913648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.913648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] PATH_INFO: `/v3/users/1bd69da6f52f45a0a02e61335d67dfac` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.913648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd69da6f52f45a0a02e61335d67dfac)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.914253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.177211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd69da6f52f45a0a02e61335d67dfac'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.178021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd69da6f52f45a0a02e61335d67dfac'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.185048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd69da6f52f45a0a02e61335d67dfac'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.185672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd69da6f52f45a0a02e61335d67dfac'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.198280 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd69da6f52f45a0a02e61335d67dfac'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.274676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1278/2550] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:10 2022] DELETE /identity/v3/users/1bd69da6f52f45a0a02e61335d67dfac => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:11.279211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.279667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.279772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.300321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:11.303960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.304962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.306398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.348757 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:11.369772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1273/2551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.375651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46649b2-9f60-41e8-8737-e649c688ad9e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.380035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.380711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.381451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.381564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.381735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.382045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] PATH_INFO: `/v3/users/8a3020f93df64f2aab880322ef0c4c30` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.383201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3020f93df64f2aab880322ef0c4c30)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.385134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.437640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc9622-9e73-4e96-ab44-45359c09a9fa None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.441877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.442509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.442796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.443059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.452000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.453423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.463600 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1274/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:11.579333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3020f93df64f2aab880322ef0c4c30'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.580012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3020f93df64f2aab880322ef0c4c30'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.584546 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:11.587563 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3020f93df64f2aab880322ef0c4c30'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.588309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3020f93df64f2aab880322ef0c4c30'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.600313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3020f93df64f2aab880322ef0c4c30'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.709714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1279/2553] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:11 2022] DELETE /identity/v3/users/8a3020f93df64f2aab880322ef0c4c30 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:11.898818 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.900675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.914817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96b4ee-15d1-4fcc-b41e-cd9d004d9d59 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.971769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.972399 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.972680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.972960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] PATH_INFO: `/v3/projects/62ae79605782481388322af78e858c27` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.974139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ae79605782481388322af78e858c27)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.976140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.992253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.992811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.008870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee24f1-dc87-4e77-a8b3-c5e2bf76e5ff admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.014819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.015496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.015863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.016140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] PATH_INFO: `/v3/projects/5c1bd55566534103b783e657c2191792` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.017569 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1bd55566534103b783e657c2191792)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.020245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.132132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ae79605782481388322af78e858c27', 'request_id': 'req-eac77b51-5d4f-4286-9999-c4bf701f98f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.137675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ae79605782481388322af78e858c27', 'request_id': 'req-eac77b51-5d4f-4286-9999-c4bf701f98f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.143984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ae79605782481388322af78e858c27', 'request_id': 'req-eac77b51-5d4f-4286-9999-c4bf701f98f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.163617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1bd55566534103b783e657c2191792', 'request_id': 'req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.251174 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] The token cache is being invalidate because project 62ae79605782481388322af78e858c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:12.251463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.252096 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.253635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1275/2554] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:11 2022] DELETE /identity/v3/projects/62ae79605782481388322af78e858c27 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:12.257560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.259573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.281873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.308630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1bd55566534103b783e657c2191792', 'request_id': 'req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.315558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1bd55566534103b783e657c2191792', 'request_id': 'req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.327020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] The token cache is being invalidate because project 5c1bd55566534103b783e657c2191792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:12.327419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.327742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac77b51-5d4f-4286-9999-c4bf701f98f7 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.328183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-bf5a4e7b-bba2-47ef-8134-0ca3dc4ef454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.330219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1280/2555] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:11 2022] DELETE /identity/v3/projects/5c1bd55566534103b783e657c2191792 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:12.335378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327a50-e673-4405-ae36-81dbd41516cb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.335733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327a50-e673-4405-ae36-81dbd41516cb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.336094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b327a50-e673-4405-ae36-81dbd41516cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.356632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7b327a50-e673-4405-ae36-81dbd41516cb None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:12.358435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7b327a50-e673-4405-ae36-81dbd41516cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.384361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.384987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.385266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.385540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] PATH_INFO: `/v3/users/858068fb8cfd45baaee8d4e4f2a48e51` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.386758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=858068fb8cfd45baaee8d4e4f2a48e51)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.388669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.417929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1281/2556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:12.425773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.426118 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.426448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.445500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:12.446738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.454601 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1282/2557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:12.459051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.467919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42033bbe-f96f-4f3f-9d25-4bc7e879d4a1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.473188 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.473824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.474249 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.474393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.475037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:12.475331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.476959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.488610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1283/2558] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:12.492892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.502208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e8f1-64ce-455f-a77a-93d10f2883c7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.506784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.507325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.507603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.507875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.508467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.510330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.545492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858068fb8cfd45baaee8d4e4f2a48e51'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.552700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858068fb8cfd45baaee8d4e4f2a48e51'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.553420 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858068fb8cfd45baaee8d4e4f2a48e51'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.554079 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858068fb8cfd45baaee8d4e4f2a48e51'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.631938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1284/2559] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:12.636094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.637861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.651833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.656615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858068fb8cfd45baaee8d4e4f2a48e51'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:12.677200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1276/2560] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:12 2022] DELETE /identity/v3/users/858068fb8cfd45baaee8d4e4f2a48e51 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:12.715868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb874e4-284c-4b56-873c-4e2654c1165a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.774690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.775178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.775516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.775793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.776420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.778962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.880933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1285/2561] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:12.886632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.897908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce16e4-91a9-42a8-8a16-f1e7fed2f63d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.903517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.904236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.904588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.904971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.905696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.907521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.918340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1277/2562] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:12.922454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.932798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c247fb-450e-4289-a595-3fd2c9bdf1bb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.937484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.938115 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.938395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.939059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.939301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.941382 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0445d-e33a-49a4-a510-28481ce7fc1d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.951444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1286/2563] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:12.956221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.966567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f470-d1e4-47f5-a895-9b9945214fb6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.971235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.971888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.972168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.972442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] PATH_INFO: `/v3/projects/74f1b917d47a471f870f178d1e9a0f9b/users/b08dd8ead1b44e74abd188ec92f6ab60/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.988028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f1b917d47a471f870f178d1e9a0f9b, user_id=b08dd8ead1b44e74abd188ec92f6ab60, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.990700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.080114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1278/2564] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:12 2022] PUT /identity/v3/projects/74f1b917d47a471f870f178d1e9a0f9b/users/b08dd8ead1b44e74abd188ec92f6ab60/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:13.090419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.090897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.091009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.112607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.114823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.123936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] MFA Rules not processed for user `b08dd8ead1b44e74abd188ec92f6ab60`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:13.124679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.139548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.200719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1287/2565] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:13.201051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059ed8-844b-4016-af65-dce56ce0c4f1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.205374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.206427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.207064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.207481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.207768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] PATH_INFO: `/v3/projects/dde33d5ea93c41d1a41e64f32bd01e5e` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.209091 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde33d5ea93c41d1a41e64f32bd01e5e)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.211030 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.217556 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b74d0-1f8b-419b-ac0b-59ce405d9651 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.222868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439901da-09df-4945-9778-f856059d41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.223737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439901da-09df-4945-9778-f856059d41bb admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.223737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439901da-09df-4945-9778-f856059d41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.224008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439901da-09df-4945-9778-f856059d41bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.224635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439901da-09df-4945-9778-f856059d41bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.226763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439901da-09df-4945-9778-f856059d41bb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.326328 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde33d5ea93c41d1a41e64f32bd01e5e', 'request_id': 'req-2cec614c-0f54-4d7b-aec8-da86008f1893'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.332190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde33d5ea93c41d1a41e64f32bd01e5e', 'request_id': 'req-2cec614c-0f54-4d7b-aec8-da86008f1893'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.338812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde33d5ea93c41d1a41e64f32bd01e5e', 'request_id': 'req-2cec614c-0f54-4d7b-aec8-da86008f1893'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.354965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1288/2566] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:13.359076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439901da-09df-4945-9778-f856059d41bb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.365055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.420856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439901da-09df-4945-9778-f856059d41bb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.422343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] The token cache is being invalidate because project dde33d5ea93c41d1a41e64f32bd01e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:13.422634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.423269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.425453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1279/2567] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:13 2022] DELETE /identity/v3/projects/dde33d5ea93c41d1a41e64f32bd01e5e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:13.426343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.427022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.427302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.427713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.428595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.429525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.430286 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.430879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.493204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec614c-0f54-4d7b-aec8-da86008f1893 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.498032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.498653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.498989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.499259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] PATH_INFO: `/v3/users/ef41c1dd15df426583c455b1b60c8bf1` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.500390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef41c1dd15df426583c455b1b60c8bf1)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.502396 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.542695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1289/2568] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:13.546662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.548297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.561149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a96e7-05be-425c-9f43-8de6cf9fff98 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.565901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.566506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.566786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.567059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.567695 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.569277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.579391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1290/2569] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:13.583344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.592978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6037-2b8f-420b-aeab-58d24c543d3a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.598099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.598767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.599042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.599320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] PATH_INFO: `/v3/projects/0f1924ece695455093d30bbd8bfaa4ab/users/42458ea454c041b4a2bb2ef6035e1e40/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.614379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1924ece695455093d30bbd8bfaa4ab, user_id=42458ea454c041b4a2bb2ef6035e1e40, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.617043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.688082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef41c1dd15df426583c455b1b60c8bf1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.697033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1291/2570] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/0f1924ece695455093d30bbd8bfaa4ab/users/42458ea454c041b4a2bb2ef6035e1e40/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:13.698153 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef41c1dd15df426583c455b1b60c8bf1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.698873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef41c1dd15df426583c455b1b60c8bf1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.699500 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef41c1dd15df426583c455b1b60c8bf1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.700866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.702504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.772974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4569c-4005-4ba8-9de4-dc478496ff4d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.778173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.778786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.779067 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.779341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.779979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.781798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.782562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-cb0a329c-042f-4a22-9047-c003701dec03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef41c1dd15df426583c455b1b60c8bf1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:13.793536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1292/2571] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:13.797609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.806074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1280/2572] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:13 2022] DELETE /identity/v3/users/ef41c1dd15df426583c455b1b60c8bf1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:13.808911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f403a-3f04-4317-babc-948d77ceb7fb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.866322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.867037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.867321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.867600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] PATH_INFO: `/v3/projects/0f1924ece695455093d30bbd8bfaa4ab/users/42458ea454c041b4a2bb2ef6035e1e40/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.869576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1924ece695455093d30bbd8bfaa4ab, user_id=42458ea454c041b4a2bb2ef6035e1e40, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.872335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.883125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1293/2573] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/0f1924ece695455093d30bbd8bfaa4ab/users/42458ea454c041b4a2bb2ef6035e1e40/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:13.886045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.895340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.895656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.895903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.926103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] MFA Rules not processed for user `42458ea454c041b4a2bb2ef6035e1e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:13.928241 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.978302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:14.010092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1281/2574] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:14.019205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.021137 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.081808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9c5e0-9966-45b9-aeaa-ff9980dcb4e9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.085800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.086436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.086717 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.086994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.096905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.098527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbea4f-90e6-4101-aa82-f54b3bd40b6c service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.108765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1294/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:14.213403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.215012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.291210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b9fc-c82a-41b9-a3d9-a104b5eeab94 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.296512 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.297136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.297419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.297692 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] PATH_INFO: `/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.298866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cfdfbd0bfc4ed7ad0809ddb61769be)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.300845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.442776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:14.446435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cfdfbd0bfc4ed7ad0809ddb61769be', 'request_id': 'req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.451951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cfdfbd0bfc4ed7ad0809ddb61769be', 'request_id': 'req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.464425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cfdfbd0bfc4ed7ad0809ddb61769be', 'request_id': 'req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.550969 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] The token cache is being invalidate because project 70cfdfbd0bfc4ed7ad0809ddb61769be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:14.558255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.558255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-1bcfb9d1-5fac-4383-bb89-2a33e1365b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.558255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1282/2576] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:14 2022] DELETE /identity/v3/projects/70cfdfbd0bfc4ed7ad0809ddb61769be => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:14.563170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.563458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.563791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.583749 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:14.586943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.645917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1295/2577] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:14.655363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.655649 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.655924 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.675772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:14.676975 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.684873 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1283/2578] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:14.689324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.700094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ba2d-2c8c-42bb-8a7b-ea4c744aeebb None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.704908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.705514 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.705803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.706119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.706838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:14.707200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.708812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.721343 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1296/2579] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:14.726045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.735477 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf04f5-6810-4d79-8cd5-d56c664aa6fc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.740592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.741206 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.741483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.741755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.742418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.744304 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.838802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1284/2580] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:14.839948 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.850808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d1ae-61db-4a09-8261-381eb9757bc1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.918478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.919187 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.919547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.919929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.920641 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.923098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.022300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1297/2581] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:15.026482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.037727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae132-7709-447e-9e7f-48e59a83530a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.042544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.043219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.043567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.043941 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.044687 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.046402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.057552 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1285/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:15.061790 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.073549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6125e-2553-4b89-bd62-79e64b061da6 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.079039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.079712 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.079987 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.080257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.080904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.082804 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.087650 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:15.100234 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1298/2583] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:15.107331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.118517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9eaad-b39a-45bb-93fd-e2e0d0f9cb4c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.123322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.124329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.124610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.124885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] PATH_INFO: `/v3/projects/05e89b7a2e674ad1b190fb391dece431/users/761abaee80e84b40b8a3e1deb8ece83e/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.126638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.128633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:15.144220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e89b7a2e674ad1b190fb391dece431, user_id=761abaee80e84b40b8a3e1deb8ece83e, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.147329 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.198721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78245-2ebf-4fc9-98be-82688e2ffcbf admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.203418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42458ea454c041b4a2bb2ef6035e1e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1924ece695455093d30bbd8bfaa4ab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.204028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.204316 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.204597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.205243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:15.206206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.207809 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8a51-2df2-476c-a778-ddd89f90a412 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.218429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1286/2584] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:15 2022] PUT /identity/v3/projects/05e89b7a2e674ad1b190fb391dece431/users/761abaee80e84b40b8a3e1deb8ece83e/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:15.230612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1299/2585] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:15.230807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.230935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.230935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.230935 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.265379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] MFA Rules not processed for user `761abaee80e84b40b8a3e1deb8ece83e`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:15.267325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:15.297779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc09e-e763-4e74-871a-4e40f7a2805e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.302802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42458ea454c041b4a2bb2ef6035e1e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1924ece695455093d30bbd8bfaa4ab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.303528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.303812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.304081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.304699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.306618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.345785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1300/2586] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:15.357864 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.359275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:15.409533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1287/2587] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:15 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:15.413902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.425611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1762-93c9-4f5d-afba-2ca49323568a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.466620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:15.483555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:15.484125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.484737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.484884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.485135 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.495773 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5c700-1440-41de-9449-baf3bbb5ad41 tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.500784 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42458ea454c041b4a2bb2ef6035e1e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1924ece695455093d30bbd8bfaa4ab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.501472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.501824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.502148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.503359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:15.503665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.505260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.517182 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1288/2588] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:15.546076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.547665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.555263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.558066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1301/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:15.567511 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7d111-73dc-400e-9ae6-1510a58455dc tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.572288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42458ea454c041b4a2bb2ef6035e1e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f1924ece695455093d30bbd8bfaa4ab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.572928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.573215 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.573493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] PATH_INFO: `/v3/projects/072fd485a15447e0a8709440a9ee7c1d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.574659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=072fd485a15447e0a8709440a9ee7c1d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.576560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.579933 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.643193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ec016-7900-40bf-a717-ab7c7c498a6a service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.648376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.648999 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.649277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.649547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] PATH_INFO: `/v3/users/761abaee80e84b40b8a3e1deb8ece83e` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.650724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] RBAC: Authorizing `identity:delete_user(user_id=761abaee80e84b40b8a3e1deb8ece83e)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.652649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.676984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072fd485a15447e0a8709440a9ee7c1d', 'request_id': 'req-04223812-dc57-4be3-930a-75489a167f3b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.683209 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072fd485a15447e0a8709440a9ee7c1d', 'request_id': 'req-04223812-dc57-4be3-930a-75489a167f3b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.689564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072fd485a15447e0a8709440a9ee7c1d', 'request_id': 'req-04223812-dc57-4be3-930a-75489a167f3b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.780401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] The token cache is being invalidate because project 072fd485a15447e0a8709440a9ee7c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:15.780696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.781343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-04223812-dc57-4be3-930a-75489a167f3b tempest-VolumeQuotaClassesTest-1161507539 tempest-VolumeQuotaClassesTest-1161507539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.782889 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1289/2590] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:15 2022] DELETE /identity/v3/projects/072fd485a15447e0a8709440a9ee7c1d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:15.818054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761abaee80e84b40b8a3e1deb8ece83e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.818803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761abaee80e84b40b8a3e1deb8ece83e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.826087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761abaee80e84b40b8a3e1deb8ece83e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.826761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761abaee80e84b40b8a3e1deb8ece83e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.839244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761abaee80e84b40b8a3e1deb8ece83e'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.926233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1302/2591] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:15 2022] DELETE /identity/v3/users/761abaee80e84b40b8a3e1deb8ece83e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:15.930796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.931085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.931384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.950774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:15.952105 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.028002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1290/2592] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:16.039389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.041318 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.054967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:16.100202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3a34f-48ff-4487-a4af-a1ef852a312b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.103881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.104487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.104767 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.105039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.114267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.115770 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.125259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1303/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:16.391898 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.393307 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.406669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e712-581f-45b4-a2a9-21ce8291d6ca None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.411775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.412469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.412790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.413062 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] PATH_INFO: `/v3/users/b08dd8ead1b44e74abd188ec92f6ab60` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.414219 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08dd8ead1b44e74abd188ec92f6ab60)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.416184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.565926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.568219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.584320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eae4-6ab8-4a5c-8547-192062b6e612 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.590746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.605586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.605586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.605586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] PATH_INFO: `/v3/projects/05e89b7a2e674ad1b190fb391dece431` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.605586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e89b7a2e674ad1b190fb391dece431)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.605586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.606508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08dd8ead1b44e74abd188ec92f6ab60'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.610271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08dd8ead1b44e74abd188ec92f6ab60'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.610950 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08dd8ead1b44e74abd188ec92f6ab60'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.611586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08dd8ead1b44e74abd188ec92f6ab60'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.707268 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-836d354c-02b0-421a-8e3c-60c96c8c98df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08dd8ead1b44e74abd188ec92f6ab60'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.710444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:16.726421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e89b7a2e674ad1b190fb391dece431', 'request_id': 'req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.726959 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1291/2594] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:16 2022] DELETE /identity/v3/users/b08dd8ead1b44e74abd188ec92f6ab60 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:16.731503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.731771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.732044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.750708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.751895 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.804166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e89b7a2e674ad1b190fb391dece431', 'request_id': 'req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.809953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1292/2595] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:16.811279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e89b7a2e674ad1b190fb391dece431', 'request_id': 'req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.820790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.822200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.823502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] The token cache is being invalidate because project 05e89b7a2e674ad1b190fb391dece431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:16.823794 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.824507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-5d98b3d9-e2a7-4d93-ae0a-1a722da47a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.826022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1304/2596] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:16 2022] DELETE /identity/v3/projects/05e89b7a2e674ad1b190fb391dece431 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:16.833046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210e73-e059-427b-bb39-fb2d918ed074 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.833339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210e73-e059-427b-bb39-fb2d918ed074 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.833612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210e73-e059-427b-bb39-fb2d918ed074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.853113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-f8210e73-e059-427b-bb39-fb2d918ed074 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.854372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f8210e73-e059-427b-bb39-fb2d918ed074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.862379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1305/2597] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:16.870639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.870924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.871323 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.881615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa97ee-6dda-4f1b-bcd9-8d2a35f279fe None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.885626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.886261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.886537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.886807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.888548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.892071 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:16.893380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.900648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.901755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1306/2598] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:16.902187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.905963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.913013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1293/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:16.915029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af7e75-8c7f-49b8-848f-3122ed7547c0 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.919850 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.929014 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.936136 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1307/2600] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:16.940642 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.951945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e7d75-4261-4853-a5df-ea9cd557e83e service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.956698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.957288 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.957602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.957875 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.958537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.960463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.070178 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1294/2601] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:16 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.074581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.084932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f5242-9aad-4ecf-bcef-d050a1817eca admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.148427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.149191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.149674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.150535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.151175 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.153608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.251321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.259147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1308/2602] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.263002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.274982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb1bb-a102-4363-bcd8-cd8bc611fa81 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.279798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.281742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.281742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.281742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.281742 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.283523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.298835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1295/2603] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.303463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.314480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6928cc-e0e5-4d86-97f0-364d9bff6cd4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.323097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.326579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.326579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.326579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.326579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.326579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.328412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.331646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.339658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1309/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.344746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.353662 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d5471-0808-4c7b-a6a7-6f2a71a3102b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.357289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d0efd-08d5-4cf1-a75b-08e7b2cc793f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.360132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.360832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.361119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.361379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] PATH_INFO: `/v3/projects/74f1b917d47a471f870f178d1e9a0f9b` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.362550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.362724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f1b917d47a471f870f178d1e9a0f9b)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.363198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.363475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.363788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] PATH_INFO: `/v3/projects/cdc4ba120ec54bb8a42e17cdf7a07b17/users/a104796313d64900868c63944b5bf9c8/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.365479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.383419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc4ba120ec54bb8a42e17cdf7a07b17, user_id=a104796313d64900868c63944b5bf9c8, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.386270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fded7c-a831-49d1-a727-887610d716b4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.445264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1310/2605] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:17 2022] PUT /identity/v3/projects/cdc4ba120ec54bb8a42e17cdf7a07b17/users/a104796313d64900868c63944b5bf9c8/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:17.488537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.490129 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f1b917d47a471f870f178d1e9a0f9b', 'request_id': 'req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.496342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f1b917d47a471f870f178d1e9a0f9b', 'request_id': 'req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.503380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f1b917d47a471f870f178d1e9a0f9b', 'request_id': 'req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.513480 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.513757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.514058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.543122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] MFA Rules not processed for user `a104796313d64900868c63944b5bf9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:17.544349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.570792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] The token cache is being invalidate because project 74f1b917d47a471f870f178d1e9a0f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:17.571084 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.571729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.573260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1296/2606] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:17 2022] DELETE /identity/v3/projects/74f1b917d47a471f870f178d1e9a0f9b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:17.577259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.578678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.612074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1311/2607] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:17.617028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.619502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.651375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8f9ad-effb-4a9e-9ea8-777ab4dac8da admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.656121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.656780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.657058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.657337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] PATH_INFO: `/v3/users/42458ea454c041b4a2bb2ef6035e1e40` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.658540 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=42458ea454c041b4a2bb2ef6035e1e40)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.660468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.686430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05a1b7-56c3-4676-bf0f-45ad3a362f43 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.691390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.692021 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.692297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.692565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.693273 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.695201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.812854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1312/2608] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:17.817619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.842678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42458ea454c041b4a2bb2ef6035e1e40'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.849441 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42458ea454c041b4a2bb2ef6035e1e40'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.850229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42458ea454c041b4a2bb2ef6035e1e40'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.851110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42458ea454c041b4a2bb2ef6035e1e40'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.878627 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d46a2-b9fc-494c-bb34-07f83f540e5a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.884062 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.884788 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.885063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.885331 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.885978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.887906 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.908920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42458ea454c041b4a2bb2ef6035e1e40'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.927037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1297/2609] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:17 2022] DELETE /identity/v3/users/42458ea454c041b4a2bb2ef6035e1e40 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:17.973177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1313/2610] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:17.974918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.976394 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.041273 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cce9a-a66b-4469-9573-9d4ff601b3ea admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.045918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.046645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.046921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.047195 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.047835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.049421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.059555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1298/2611] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:18.061411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.063719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.074264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97463aa-ca53-4ccd-87b9-714202482fec admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.078918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.079561 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.079841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.080114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] PATH_INFO: `/v3/projects/89d8e2efa27e415fb53c37420419382f/users/47ca6be280934015b0429aafef476456/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.095843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d8e2efa27e415fb53c37420419382f, user_id=47ca6be280934015b0429aafef476456, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.098635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.206236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1314/2612] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:18 2022] PUT /identity/v3/projects/89d8e2efa27e415fb53c37420419382f/users/47ca6be280934015b0429aafef476456/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:18.210478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.221800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d513ce7-b7b7-4293-bef1-f7ad8d5428ca admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.275520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.288347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.288976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.289256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.289533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.290261 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.291878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.302083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1299/2613] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:18.306333 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.311635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.313830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.318678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182999d-108b-4f95-9f84-3ae44d672abe admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.324210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.324918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.325189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.325651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] PATH_INFO: `/v3/projects/89d8e2efa27e415fb53c37420419382f/users/47ca6be280934015b0429aafef476456/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.327743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d8e2efa27e415fb53c37420419382f, user_id=47ca6be280934015b0429aafef476456, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.330909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0d474-c75e-4d52-ba5c-c3821899ea26 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.331032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526df850-a3c8-4b75-8690-9c3dc50ad64e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.333237 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.333871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.334185 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.334464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] PATH_INFO: `/v3/projects/0f1924ece695455093d30bbd8bfaa4ab` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.335605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1924ece695455093d30bbd8bfaa4ab)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.337534 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.342686 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1315/2614] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:18 2022] PUT /identity/v3/projects/89d8e2efa27e415fb53c37420419382f/users/47ca6be280934015b0429aafef476456/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:18.352568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.352857 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.353134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.382391 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] MFA Rules not processed for user `47ca6be280934015b0429aafef476456`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:18.383606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.429236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1924ece695455093d30bbd8bfaa4ab', 'request_id': 'req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:18.434865 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1924ece695455093d30bbd8bfaa4ab', 'request_id': 'req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:18.441774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1924ece695455093d30bbd8bfaa4ab', 'request_id': 'req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:18.452733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1316/2615] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:18.463596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.464929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.518339 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] The token cache is being invalidate because project 0f1924ece695455093d30bbd8bfaa4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:18.518634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:18.519269 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b21c0adb-6012-4bbd-bca4-81e5dbf6d9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:18.520776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1300/2616] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:18 2022] DELETE /identity/v3/projects/0f1924ece695455093d30bbd8bfaa4ab => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:18.524900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ac3c-5c69-40c8-9229-83e0a67af990 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.525778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fbe32-394a-4093-9e48-7ff018b0c687 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.526117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fbe32-394a-4093-9e48-7ff018b0c687 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.526417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fbe32-394a-4093-9e48-7ff018b0c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.547342 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eb8fbe32-394a-4093-9e48-7ff018b0c687 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:18.548554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eb8fbe32-394a-4093-9e48-7ff018b0c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.554302 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.574300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.574915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.575191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.575462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.580517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.609516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1301/2617] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:18.617803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.618135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.618408 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.638848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:18.640187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.640560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.642082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.648740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1302/2618] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:18.651417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1317/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:18.653200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.663151 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f50c-8ff1-4569-9f8f-c741c8feec65 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.667879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.668468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.668940 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.669212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.669856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:18.670274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.671930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.684452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1303/2620] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:18.686383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.688978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.700413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18813c-b4ca-4ce3-a3d5-a77b96fbfae8 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.705209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.705810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.706130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.706407 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.707045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.709000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.802568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1318/2621] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:18.806956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.817109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f833a-3ea2-495b-874b-de0c0fafc73c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.873549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.874196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.874478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.874750 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.875391 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.877296 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.962575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1304/2622] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:18.963796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.975094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434c878-c775-45bf-8864-1ffe49fa402e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.979784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.980379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.981883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.981883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.981883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.983374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.995045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1319/2623] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:18.999142 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.009316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ccda0-94f3-4299-89e3-5ae6812d9a0f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.013960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.014564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.014836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.015203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.015841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.017421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f774-d38e-48d2-81b4-91a711e2a112 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.028731 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1305/2624] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:19.033728 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.043607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9541b8-e068-41b7-bd4f-d72f25a9834c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.048182 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.048812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.049085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.049353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] PATH_INFO: `/v3/projects/7beb4d57cb934a36b8b573a56b99a2ba/users/f11bde85117f4798ac28c30a15269e8f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.064678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7beb4d57cb934a36b8b573a56b99a2ba, user_id=f11bde85117f4798ac28c30a15269e8f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.067589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.154503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1320/2625] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:19 2022] PUT /identity/v3/projects/7beb4d57cb934a36b8b573a56b99a2ba/users/f11bde85117f4798ac28c30a15269e8f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:19.165435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.165729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.166042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.194528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] MFA Rules not processed for user `f11bde85117f4798ac28c30a15269e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:19.195685 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:19.263811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1306/2626] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:19.268679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.337169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b2f06-27dd-400b-8f29-32f872c2dda9 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.342087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.342693 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.342979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.343248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.350610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.350610 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.413094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1321/2627] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:19 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:19.417347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.428099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb556ff-fbfa-4b7b-8e1d-9d627da3c66e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.484358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.484884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.485162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.485433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.486074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.487967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.495669 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:19.589113 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1307/2628] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:19 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:19.593209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.603777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d82fa-9778-4756-a9fd-7ba26e01de67 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.608703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.609295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.609574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.609894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.610570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.612162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.626265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1322/2629] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:19.627553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.638224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5b399-ddb4-4868-b0e8-56ee684120e9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.643022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.643663 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.643937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.644207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] PATH_INFO: `/v3/projects/dc2b010d692e474f8454910deaf7ef26/users/a5898b08858d4070aa3124dfc97bf57d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.659946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b010d692e474f8454910deaf7ef26, user_id=a5898b08858d4070aa3124dfc97bf57d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.662621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.766623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1308/2630] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:19 2022] PUT /identity/v3/projects/dc2b010d692e474f8454910deaf7ef26/users/a5898b08858d4070aa3124dfc97bf57d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:19.770618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.777577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:19.781834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839a9ba-e721-47a4-9847-4ceeabab8efd admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.838017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.838701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.838982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.839257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.839895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.841483 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd74b4-0637-4146-9b38-6ca05dd01d13 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.851522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1323/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:19.855351 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.866188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0be5a-050b-4abd-90b7-03a06553f486 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.870781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.871416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.871691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.871962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] PATH_INFO: `/v3/projects/dc2b010d692e474f8454910deaf7ef26/users/a5898b08858d4070aa3124dfc97bf57d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.873860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2b010d692e474f8454910deaf7ef26, user_id=a5898b08858d4070aa3124dfc97bf57d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.876568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.887228 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1309/2632] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:19 2022] PUT /identity/v3/projects/dc2b010d692e474f8454910deaf7ef26/users/a5898b08858d4070aa3124dfc97bf57d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:19.898818 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.906439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.906439 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.926254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] MFA Rules not processed for user `a5898b08858d4070aa3124dfc97bf57d`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:19.927992 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:19.994459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1324/2633] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:20.006139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:20.007789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:20.064816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00f48-78ff-4c1d-a2c8-d0f955559816 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:20.068452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:20.069048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:20.069319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:20.069590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:20.078780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:20.080208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:20.090070 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1310/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:20.136503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:20.137900 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:20.150017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db5456-b552-4e5b-bf82-ed94355956f1 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:20.153619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:20.154245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:20.154527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:20.154799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:20.210984 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:20.212420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0904d-07e9-46bb-806a-fbaa6ffdac59 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:20.221738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1325/2635] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:21.674083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:21.675582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:21.741015 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839547-bb23-40a3-a102-8d55853aee45 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:21.745607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:21.750041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:21.750041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:21.750041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] PATH_INFO: `/v3/users/a104796313d64900868c63944b5bf9c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:21.750041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a104796313d64900868c63944b5bf9c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:21.750041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:21.948775 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a104796313d64900868c63944b5bf9c8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:21.955564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a104796313d64900868c63944b5bf9c8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:21.956256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a104796313d64900868c63944b5bf9c8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:21.956874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a104796313d64900868c63944b5bf9c8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:21.959271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:22.051668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a104796313d64900868c63944b5bf9c8'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.070715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1311/2636] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:21 2022] DELETE /identity/v3/users/a104796313d64900868c63944b5bf9c8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:22.075379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:22.075847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:22.075968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:22.099132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:22.100345 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:22.118853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=100 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:22.159367 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1326/2637] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:22.169840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:22.171343 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:22.229122 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140aa9a-59b0-452c-af2a-bc0eb0f05a52 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:22.232665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:22.233264 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:22.233543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:22.233811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:22.243000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:22.246359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:22.254225 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1312/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:22.704859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:22.706427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:22.721055 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95388ef6-78d3-461b-bb8b-d53d3d694104 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:22.727113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:22.728403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:22.728755 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:22.729097 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] PATH_INFO: `/v3/projects/cdc4ba120ec54bb8a42e17cdf7a07b17` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:22.730920 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc4ba120ec54bb8a42e17cdf7a07b17)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:22.732832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:22.874828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc4ba120ec54bb8a42e17cdf7a07b17', 'request_id': 'req-62067496-2e53-44f1-91ed-1dc835e84a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.954043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc4ba120ec54bb8a42e17cdf7a07b17', 'request_id': 'req-62067496-2e53-44f1-91ed-1dc835e84a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.961056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc4ba120ec54bb8a42e17cdf7a07b17', 'request_id': 'req-62067496-2e53-44f1-91ed-1dc835e84a2a'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.971760 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] The token cache is being invalidate because project cdc4ba120ec54bb8a42e17cdf7a07b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:22.972043 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.972720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:22.974873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1327/2639] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:22 2022] DELETE /identity/v3/projects/cdc4ba120ec54bb8a42e17cdf7a07b17 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:22.978956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:22.989505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1afe-e695-46d7-a1a7-aac8e230a647 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:23.058145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:23.058781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:23.059063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:23.059345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] PATH_INFO: `/v3/users/47ca6be280934015b0429aafef476456` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:23.060538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ca6be280934015b0429aafef476456)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:23.062533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:23.225247 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ca6be280934015b0429aafef476456'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.232175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ca6be280934015b0429aafef476456'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.232953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ca6be280934015b0429aafef476456'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.233522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ca6be280934015b0429aafef476456'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.303233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-8a0556b0-fc03-407c-aca6-67ce851fde01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ca6be280934015b0429aafef476456'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.315213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:23.322258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1313/2640] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:22 2022] DELETE /identity/v3/users/47ca6be280934015b0429aafef476456 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:23.760896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:23.762427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:23.776371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067496-2e53-44f1-91ed-1dc835e84a2a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:23.835387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:23.836073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:23.836383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:23.836660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] PATH_INFO: `/v3/projects/89d8e2efa27e415fb53c37420419382f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:23.837828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d8e2efa27e415fb53c37420419382f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:23.839810 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:23.937493 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d8e2efa27e415fb53c37420419382f', 'request_id': 'req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:23.939267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:24.023758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d8e2efa27e415fb53c37420419382f', 'request_id': 'req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:24.030390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d8e2efa27e415fb53c37420419382f', 'request_id': 'req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:24.041346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] The token cache is being invalidate because project 89d8e2efa27e415fb53c37420419382f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:24.041635 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:24.042339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-8c07af7e-410b-4cbc-b2ee-ea653f2814f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:24.043890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1328/2641] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:23 2022] DELETE /identity/v3/projects/89d8e2efa27e415fb53c37420419382f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:24.049005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.049515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.049626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.070271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:24.071501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:24.133788 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1314/2642] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:24.142087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.142375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.142651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.163904 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:24.165116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:24.173000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1329/2643] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:24.177280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.186762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17edb7-6186-4b9c-8952-82e690cf3eac None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.191301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.191910 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.192204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.192488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.193132 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:24.193431 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.195042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.206677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1315/2644] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:24.211542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.220832 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badabecf-dac2-4ef4-a89b-ffec89444976 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.226464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.227061 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.227341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.227616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.228247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.230239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.315892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1330/2645] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:24 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:24.320068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.330221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e58f64-f5b5-4dac-bc61-2909c26f1af2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.388446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.389063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.389346 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.389633 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.390323 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.392361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.491549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1316/2646] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:24 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:24.495678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.506052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3413db-21ae-46e1-8a07-eb0795a4db25 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.510777 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.511377 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.511655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.511928 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.512575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.514206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.528252 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1331/2647] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:24.529404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.540369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f1b00-701c-48de-b11a-81f5c08d67f5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.545111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.545706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.546014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.546293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.546939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.548544 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba300c97-35a9-4419-a37c-f434eb1e54bc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.563183 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1317/2648] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:24.564425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.575161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84416fc-7ed7-4204-8731-89067977845c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.580321 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.580974 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.581253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.581526 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] PATH_INFO: `/v3/projects/6811cff620454ada8f7f335904122c6d/users/ac35a86cc2b748bd993d7a3948cbaac0/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.597519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6811cff620454ada8f7f335904122c6d, user_id=ac35a86cc2b748bd993d7a3948cbaac0, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.602355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.704585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1332/2649] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:24 2022] PUT /identity/v3/projects/6811cff620454ada8f7f335904122c6d/users/ac35a86cc2b748bd993d7a3948cbaac0/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:24.718021 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.718312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.718589 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.748869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] MFA Rules not processed for user `ac35a86cc2b748bd993d7a3948cbaac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:24.750158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:24.798881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:24.815470 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1318/2650] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:24.827256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:24.829034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:24.888244 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aafb6-5132-436c-ac1f-d8b88f8a1b3c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:24.894339 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:24.895347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:24.895669 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:24.895973 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:24.907202 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:24.908823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:24.920968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1333/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:24.949971 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:25.022962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab574497-08c7-403c-93c5-33509659dcd7 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:25.027790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:25.028418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.028700 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.028977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] PATH_INFO: `/v3/users/ac35a86cc2b748bd993d7a3948cbaac0` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.030165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac35a86cc2b748bd993d7a3948cbaac0)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:25.032075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:25.277705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac35a86cc2b748bd993d7a3948cbaac0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.284196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:25.285830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:25.286840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac35a86cc2b748bd993d7a3948cbaac0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.287596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac35a86cc2b748bd993d7a3948cbaac0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.288191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac35a86cc2b748bd993d7a3948cbaac0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.300436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273f764-9d42-4f5a-972c-90c85f383ca5 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:25.305750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:25.306397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.306680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.306959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] PATH_INFO: `/v3/users/f11bde85117f4798ac28c30a15269e8f` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.308093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11bde85117f4798ac28c30a15269e8f)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:25.310050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:25.410012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-57da3953-081a-4e0f-ba5b-6d84e882ffcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac35a86cc2b748bd993d7a3948cbaac0'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.428832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1319/2652] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:24 2022] DELETE /identity/v3/users/ac35a86cc2b748bd993d7a3948cbaac0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:25.433262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.433553 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.433831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.452163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:25.453493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:25.525196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1320/2653] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:25.535255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:25.537148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:25.549930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:25.593278 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13557f8b-8dae-479a-a2c9-629a2d8212e0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:25.596989 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:25.597580 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.597856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.598154 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.607678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:25.609081 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ece19d-1041-4d5f-874e-4556d4c67179 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:25.618979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1321/2654] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:25.679553 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11bde85117f4798ac28c30a15269e8f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.681036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11bde85117f4798ac28c30a15269e8f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.688375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11bde85117f4798ac28c30a15269e8f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.694125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11bde85117f4798ac28c30a15269e8f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.695750 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:25.702932 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11bde85117f4798ac28c30a15269e8f'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:25.754503 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1334/2655] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:25 2022] DELETE /identity/v3/users/f11bde85117f4798ac28c30a15269e8f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:25.760006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.760290 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.760563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.789527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:25.791560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:25.876184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1322/2656] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:25.886792 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:25.888258 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:25.948626 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c2e0a-febf-4158-a103-d77d093e4d83 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:25.952297 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:25.952982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:25.953582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:25.953582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:25.963094 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:25.967251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:25.974019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1335/2657] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:26.123463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:26.125090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.137579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d806c9-0a95-4a20-8a61-11e7bebe64c5 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:26.142863 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:26.143509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.143803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.144074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] PATH_INFO: `/v3/projects/6811cff620454ada8f7f335904122c6d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.145221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6811cff620454ada8f7f335904122c6d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:26.150948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:26.276316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6811cff620454ada8f7f335904122c6d', 'request_id': 'req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.282199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6811cff620454ada8f7f335904122c6d', 'request_id': 'req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.289337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6811cff620454ada8f7f335904122c6d', 'request_id': 'req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.401148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] The token cache is being invalidate because project 6811cff620454ada8f7f335904122c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:26.401538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.402255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.404099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1323/2658] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:26 2022] DELETE /identity/v3/projects/6811cff620454ada8f7f335904122c6d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:26.494894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:26.496636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.517924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620ff13-3cb4-41d6-8f3d-00698cdb2c9d service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:26.587488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:26.588163 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.588446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.588723 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] PATH_INFO: `/v3/projects/7beb4d57cb934a36b8b573a56b99a2ba` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.589949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7beb4d57cb934a36b8b573a56b99a2ba)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:26.591947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:26.702189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7beb4d57cb934a36b8b573a56b99a2ba', 'request_id': 'req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.781482 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7beb4d57cb934a36b8b573a56b99a2ba', 'request_id': 'req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.788773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7beb4d57cb934a36b8b573a56b99a2ba', 'request_id': 'req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.799281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] The token cache is being invalidate because project 7beb4d57cb934a36b8b573a56b99a2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:26.799578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.800279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:26.801877 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1336/2659] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:26 2022] DELETE /identity/v3/projects/7beb4d57cb934a36b8b573a56b99a2ba => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:26.807145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:26.807546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:26.820830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e29b-5e72-4379-8ed2-585dcb401f7c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:26.854226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:26.876828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:26.877018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:26.877253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:26.877527 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] PATH_INFO: `/v3/users/a5898b08858d4070aa3124dfc97bf57d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:26.878666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5898b08858d4070aa3124dfc97bf57d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:26.881104 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:27.088331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5898b08858d4070aa3124dfc97bf57d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.095224 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5898b08858d4070aa3124dfc97bf57d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.095878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5898b08858d4070aa3124dfc97bf57d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.096495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5898b08858d4070aa3124dfc97bf57d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.160372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-a57299ce-2a17-47e4-93a3-025a014501d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5898b08858d4070aa3124dfc97bf57d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.178249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1324/2660] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:26 2022] DELETE /identity/v3/users/a5898b08858d4070aa3124dfc97bf57d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:27.607803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:27.609330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:27.624276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee1dcd-0e20-45c1-9e5a-e2d3a7121bb5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:27.634095 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:27.682889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:27.683520 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:27.683800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:27.684076 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] PATH_INFO: `/v3/projects/dc2b010d692e474f8454910deaf7ef26` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:27.685239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2b010d692e474f8454910deaf7ef26)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:27.687210 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:27.823752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2b010d692e474f8454910deaf7ef26', 'request_id': 'req-19f4a570-ae7e-47a5-9311-a417d3b5b458'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.880267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2b010d692e474f8454910deaf7ef26', 'request_id': 'req-19f4a570-ae7e-47a5-9311-a417d3b5b458'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.886711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2b010d692e474f8454910deaf7ef26', 'request_id': 'req-19f4a570-ae7e-47a5-9311-a417d3b5b458'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.898028 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] The token cache is being invalidate because project dc2b010d692e474f8454910deaf7ef26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:27.898320 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.898977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-19f4a570-ae7e-47a5-9311-a417d3b5b458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:27.900491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1337/2661] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:27 2022] DELETE /identity/v3/projects/dc2b010d692e474f8454910deaf7ef26 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:27.905293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:27.905789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:27.905899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:27.925855 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:27.927117 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:27.985729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1325/2662] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:27.994010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:27.994298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:27.994570 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.014289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:28.015471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:28.023535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1338/2663] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:28.027870 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.038467 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3965-fd66-4965-a2f6-251ce6dc03aa None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.044167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.044760 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.045060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.045327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.045999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:28.046302 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.054008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.060235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1326/2664] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:28.064867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.074891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8abfa-7469-4e0a-85a5-a743ea4b87d4 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.079589 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.080183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.080466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.080742 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.081402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.083374 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.183929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1339/2665] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:28.187996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.199607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a12-7050-4772-8730-afb1476462e2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.241065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:28.255985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.256576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.256849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.257116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.257721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.259813 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.413380 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1327/2666] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:28.417819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.428744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070b3d0-e95f-4311-89c3-b972c6dd0dd7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.433517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.434140 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.434419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.434688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.435378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.437000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.446955 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1340/2667] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:28.450857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.460938 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef76475-fae8-4f17-9c2d-784c6e8815cb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.465576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.466197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.466489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.466801 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.467439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.469017 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094358ca-d1a1-44dd-acaa-21fcc7eb535c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.479918 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1328/2668] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:28.483914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.494619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d1a24-ef30-4e15-8705-ea8784563885 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.499152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.499787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.500069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.500342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] PATH_INFO: `/v3/projects/5b98ec336e2e4401aa5711d5cf9ffd87/users/97a28724f20d498aa43b7d48d7c2d588/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.514525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b98ec336e2e4401aa5711d5cf9ffd87, user_id=97a28724f20d498aa43b7d48d7c2d588, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.517160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.592945 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1341/2669] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:28 2022] PUT /identity/v3/projects/5b98ec336e2e4401aa5711d5cf9ffd87/users/97a28724f20d498aa43b7d48d7c2d588/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:28.604756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.609111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.609111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.633322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] MFA Rules not processed for user `97a28724f20d498aa43b7d48d7c2d588`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:28.634604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:28.699579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1329/2670] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:28.704145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.747855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:28.768330 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9db279-b773-4547-8bf3-e48e3df1aa11 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.774154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.774766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.775050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.775327 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.776049 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.778044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:28.874041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1342/2671] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:28.878187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:28.888928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35189-8415-4fca-b5cf-898400245e70 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:28.946045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:28.946702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:28.946944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:28.947184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:28.947823 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:28.949739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.067899 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1330/2672] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:28 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:29.072051 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.082437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec1820-e0ac-43c8-a151-d54f506a8b98 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.087773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.088365 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.088645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.088978 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.089619 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.091254 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.101096 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1343/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:29.105191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.115187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50462-5a8e-410d-ab60-4155ee4df622 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.119879 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.120517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.120798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.121075 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] PATH_INFO: `/v3/projects/d7a58b782193473ea93b5584e5cf9cfe/users/087d0db7cf244b0b9ee0090cd1a2ff49/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.136664 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a58b782193473ea93b5584e5cf9cfe, user_id=087d0db7cf244b0b9ee0090cd1a2ff49, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.139324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.204817 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1331/2674] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:29 2022] PUT /identity/v3/projects/d7a58b782193473ea93b5584e5cf9cfe/users/087d0db7cf244b0b9ee0090cd1a2ff49/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:29.209400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.219427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2301b-bd04-44ba-8f05-8655bfc20e20 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.276130 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.276735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.277013 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.277284 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.277922 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.279573 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b883ce-ce99-469a-ae5e-418863794bda admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.289433 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1344/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:29.293814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.304040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5c9a-6441-4a44-8fb9-0b4c14132fd1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.308691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.309332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.309611 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.309884 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] PATH_INFO: `/v3/projects/d7a58b782193473ea93b5584e5cf9cfe/users/087d0db7cf244b0b9ee0090cd1a2ff49/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.311829 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a58b782193473ea93b5584e5cf9cfe, user_id=087d0db7cf244b0b9ee0090cd1a2ff49, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.314464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.325032 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1332/2676] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:29 2022] PUT /identity/v3/projects/d7a58b782193473ea93b5584e5cf9cfe/users/087d0db7cf244b0b9ee0090cd1a2ff49/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:29.335879 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.336281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.336558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.364120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] MFA Rules not processed for user `087d0db7cf244b0b9ee0090cd1a2ff49`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:29.365393 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:29.439401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1345/2677] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:29.451150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:29.452888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:29.460621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:29.514568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac83d-4df7-4ef0-8be6-341b2d173a03 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:29.518340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:29.518935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:29.519303 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:29.519846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:29.529665 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:29.531124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539abd9-7ee3-4cd7-859f-9c9299369ef0 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:29.540448 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1333/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:30.581012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:30.619953 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:30.642731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274840a-2b91-4521-ba62-277434c2bf9e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:30.648194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:30.648813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:30.649120 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:30.649390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] PATH_INFO: `/v3/users/97a28724f20d498aa43b7d48d7c2d588` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:30.650535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a28724f20d498aa43b7d48d7c2d588)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:30.652453 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:30.821078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a28724f20d498aa43b7d48d7c2d588'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:30.821660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a28724f20d498aa43b7d48d7c2d588'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:30.829366 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a28724f20d498aa43b7d48d7c2d588'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:30.830044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a28724f20d498aa43b7d48d7c2d588'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:30.842460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a28724f20d498aa43b7d48d7c2d588'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:30.919077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1346/2679] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:30 2022] DELETE /identity/v3/users/97a28724f20d498aa43b7d48d7c2d588 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:30.923682 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:30.924191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:30.924341 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:30.944049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:30.945253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:31.002473 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1334/2680] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:31.013106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:31.014558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:31.073262 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751792a-b88a-482e-b4a4-183400c059c2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:31.076837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:31.077441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.077726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.078033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.087519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:31.088967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:31.099008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1347/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:31.521203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:31.523614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:31.537403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227428bc-6efe-4356-bedd-79d67ed54b86 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:31.542911 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:31.543554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.543830 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.544103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] PATH_INFO: `/v3/projects/5b98ec336e2e4401aa5711d5cf9ffd87` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.545229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b98ec336e2e4401aa5711d5cf9ffd87)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:31.547367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:31.686766 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b98ec336e2e4401aa5711d5cf9ffd87', 'request_id': 'req-9fd72561-affc-4aa8-aa1d-017408d73533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.692232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b98ec336e2e4401aa5711d5cf9ffd87', 'request_id': 'req-9fd72561-affc-4aa8-aa1d-017408d73533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.698714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b98ec336e2e4401aa5711d5cf9ffd87', 'request_id': 'req-9fd72561-affc-4aa8-aa1d-017408d73533'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.794374 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] The token cache is being invalidate because project 5b98ec336e2e4401aa5711d5cf9ffd87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:31.794702 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.795379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.796958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1335/2682] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:31 2022] DELETE /identity/v3/projects/5b98ec336e2e4401aa5711d5cf9ffd87 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:31.801203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:31.811044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b3402-b11b-4dad-a17b-cd9c4a42ddbf service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:31.861602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:31.867585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:31.868208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.868490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.868763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] PATH_INFO: `/v3/users/087d0db7cf244b0b9ee0090cd1a2ff49` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.869888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087d0db7cf244b0b9ee0090cd1a2ff49)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:31.874016 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:32.076909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087d0db7cf244b0b9ee0090cd1a2ff49'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.077496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087d0db7cf244b0b9ee0090cd1a2ff49'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.085139 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087d0db7cf244b0b9ee0090cd1a2ff49'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.085779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087d0db7cf244b0b9ee0090cd1a2ff49'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.097639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-731d541b-5d39-4815-8b1b-bfd481e72141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087d0db7cf244b0b9ee0090cd1a2ff49'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.166268 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1348/2683] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:31 2022] DELETE /identity/v3/users/087d0db7cf244b0b9ee0090cd1a2ff49 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:32.590746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:32.595000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:32.606285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd72561-affc-4aa8-aa1d-017408d73533 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:32.639038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:32.666088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:32.666713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:32.666990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:32.667260 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] PATH_INFO: `/v3/projects/d7a58b782193473ea93b5584e5cf9cfe` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:32.668518 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a58b782193473ea93b5584e5cf9cfe)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:32.673613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:32.787783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a58b782193473ea93b5584e5cf9cfe', 'request_id': 'req-e53a9021-de13-4a86-9c89-904befd02aaa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.793402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a58b782193473ea93b5584e5cf9cfe', 'request_id': 'req-e53a9021-de13-4a86-9c89-904befd02aaa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.799563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a58b782193473ea93b5584e5cf9cfe', 'request_id': 'req-e53a9021-de13-4a86-9c89-904befd02aaa'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.878722 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] The token cache is being invalidate because project d7a58b782193473ea93b5584e5cf9cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:32.879041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.879709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e53a9021-de13-4a86-9c89-904befd02aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.881236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1336/2684] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:32 2022] DELETE /identity/v3/projects/d7a58b782193473ea93b5584e5cf9cfe => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:32.886121 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:32.886579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:32.886689 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:32.907668 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:32.908868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:32.966581 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1349/2685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:32.974688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096967-37e3-48ff-acaa-9596502a537c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:32.974978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096967-37e3-48ff-acaa-9596502a537c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:32.975255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096967-37e3-48ff-acaa-9596502a537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:32.994828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-56096967-37e3-48ff-acaa-9596502a537c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:32.996022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-56096967-37e3-48ff-acaa-9596502a537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:33.003740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1337/2686] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:33.007754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.017409 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013616-48fb-4748-b56b-77a9a513a185 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.022469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.023093 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.023371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.023643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.024322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:33.024625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.026247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.038211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1350/2687] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:33.046554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56096967-37e3-48ff-acaa-9596502a537c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.056452 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56096967-37e3-48ff-acaa-9596502a537c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.061063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.061651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.061928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.062279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.062874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.064758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.190904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1338/2688] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:33.195166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.205194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ba80-0458-4160-9637-fbcf5dffefb7 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.262660 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.263270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.263549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.263819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.264457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.266423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.277338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:33.393800 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1351/2689] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:33.398857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.410516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e7b4-b535-42d0-911d-dcc0eab47d8e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.415964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.416577 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.416853 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.417123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.417769 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.420515 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.430836 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1339/2690] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:33.434899 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.446281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f46a-1618-4424-a427-0cd66f120385 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.451289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.451875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.452155 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.452428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.453070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.454700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affdb4d-cd23-4875-af3b-de5a75ded021 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.465651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1352/2691] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:33.469703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.480199 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b47d3-0522-4fb2-8fb0-d15ae32c98b0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.484785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.485424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.485708 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.486019 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] PATH_INFO: `/v3/projects/4cb383a24bd84da88d11580c506d7b45/users/0c37f41fc1f54e2ca4768f6eae36a216/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.500285 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb383a24bd84da88d11580c506d7b45, user_id=0c37f41fc1f54e2ca4768f6eae36a216, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.502976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.577347 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1340/2692] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:33 2022] PUT /identity/v3/projects/4cb383a24bd84da88d11580c506d7b45/users/0c37f41fc1f54e2ca4768f6eae36a216/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:33.589446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.589734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.590045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.618298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] MFA Rules not processed for user `0c37f41fc1f54e2ca4768f6eae36a216`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:33.619507 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:33.688103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1353/2693] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:33.693236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.760119 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:33.763696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a7b2e-65ec-465d-bff8-87a4e524a43d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.768549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.769141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.769418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.769688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.770356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.773125 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.864254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1341/2694] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:33.868448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.879265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947eb7d-6472-41ea-9df7-5ffcfaf5b845 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.935082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.935720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.935940 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.936212 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.936823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.938763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.027640 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1354/2695] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:34.031715 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.042102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbaf24-3ef0-41af-afca-3d15dac692e3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.046671 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.047258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.047538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.047809 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.048521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.050190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.060768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1342/2696] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:34.064834 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.075869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e8bb-b084-468c-8abe-a7be76c320ed admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.080597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.081240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.081521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.081796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] PATH_INFO: `/v3/projects/4ed046a1baa0410abbbbc1fef389910c/users/3980704657e24e25b99304ba82fd2c7d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.096434 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed046a1baa0410abbbbc1fef389910c, user_id=3980704657e24e25b99304ba82fd2c7d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.099125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.175934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1355/2697] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:34 2022] PUT /identity/v3/projects/4ed046a1baa0410abbbbc1fef389910c/users/3980704657e24e25b99304ba82fd2c7d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:34.180359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.190507 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc41d5-aceb-433b-b57e-54add1f5e140 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.246733 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.247332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.247613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.247892 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.248529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.250143 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1229bd-6d4e-4f7b-827e-dafabf6fc3e4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.260332 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1343/2698] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:34.264711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.278469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77211236-4513-4842-b3a7-5f7dc4b59714 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.283183 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.283870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.284152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.284427 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] PATH_INFO: `/v3/projects/4ed046a1baa0410abbbbc1fef389910c/users/3980704657e24e25b99304ba82fd2c7d/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.286894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed046a1baa0410abbbbc1fef389910c, user_id=3980704657e24e25b99304ba82fd2c7d, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.289784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.300276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1356/2699] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:34 2022] PUT /identity/v3/projects/4ed046a1baa0410abbbbc1fef389910c/users/3980704657e24e25b99304ba82fd2c7d/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:34.311378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.317516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.317516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.340709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] MFA Rules not processed for user `3980704657e24e25b99304ba82fd2c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:34.341896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.409623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1344/2700] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:34.420764 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.422527 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.450405 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:34.480908 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22969255-6045-46b4-9da2-83349f1530aa admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.484558 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.485203 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.485665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.486215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.496387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.497823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c6a4-27c7-4c9f-8318-bff534d9ea89 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.507317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1357/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:35.010060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.061824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:35.072789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6369bd-e432-46f4-a1a3-dd4b3bfcb4cb None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.077476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.078123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.078406 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.078681 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] PATH_INFO: `/v3/users/0c37f41fc1f54e2ca4768f6eae36a216` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.079932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c37f41fc1f54e2ca4768f6eae36a216)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.081846 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.240882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c37f41fc1f54e2ca4768f6eae36a216'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.247816 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c37f41fc1f54e2ca4768f6eae36a216'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.248525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c37f41fc1f54e2ca4768f6eae36a216'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.249418 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c37f41fc1f54e2ca4768f6eae36a216'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.338130 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c37f41fc1f54e2ca4768f6eae36a216'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:35.357078 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1345/2702] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:35 2022] DELETE /identity/v3/users/0c37f41fc1f54e2ca4768f6eae36a216 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:35.361703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.362487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.362679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.382896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:35.384085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.442236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1358/2703] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:35.452648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.454128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.511378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62602b08-246d-4399-8b02-7b1274362618 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.514952 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.515543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.515828 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.516101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.525286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.526746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.536106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1346/2704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:35.922598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.924032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.936801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ef5a7-5e23-4d4d-92ae-83804f04fb8e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.941479 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.942160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.942490 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.942796 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] PATH_INFO: `/v3/projects/4cb383a24bd84da88d11580c506d7b45` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.943943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb383a24bd84da88d11580c506d7b45)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.945989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.041758 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb383a24bd84da88d11580c506d7b45', 'request_id': 'req-dbcead77-402d-488d-b459-b6050ff95cae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.090123 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb383a24bd84da88d11580c506d7b45', 'request_id': 'req-dbcead77-402d-488d-b459-b6050ff95cae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.096337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb383a24bd84da88d11580c506d7b45', 'request_id': 'req-dbcead77-402d-488d-b459-b6050ff95cae'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.107086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] The token cache is being invalidate because project 4cb383a24bd84da88d11580c506d7b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:36.107371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.107988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.109576 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1359/2705] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:35 2022] DELETE /identity/v3/projects/4cb383a24bd84da88d11580c506d7b45 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:36.113538 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.132748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764192-eba3-436f-a703-39f69131f689 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.202960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.203586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.203866 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.204139 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] PATH_INFO: `/v3/users/3980704657e24e25b99304ba82fd2c7d` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.205275 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3980704657e24e25b99304ba82fd2c7d)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.207263 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.222739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:36.403197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3980704657e24e25b99304ba82fd2c7d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.410220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3980704657e24e25b99304ba82fd2c7d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.410894 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3980704657e24e25b99304ba82fd2c7d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.411493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3980704657e24e25b99304ba82fd2c7d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.503883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-333602a2-87c2-4922-aa8d-7d7290bd91ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3980704657e24e25b99304ba82fd2c7d'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:36.524048 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1347/2706] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:36 2022] DELETE /identity/v3/users/3980704657e24e25b99304ba82fd2c7d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:36.956617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.958574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.972875 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcead77-402d-488d-b459-b6050ff95cae admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.024609 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:37.034219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.034843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.035122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.035395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] PATH_INFO: `/v3/projects/4ed046a1baa0410abbbbc1fef389910c` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.036511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed046a1baa0410abbbbc1fef389910c)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.038495 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.138751 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed046a1baa0410abbbbc1fef389910c', 'request_id': 'req-3aac5445-a8d5-463e-bd82-cb9d09a651dc'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.221450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed046a1baa0410abbbbc1fef389910c', 'request_id': 'req-3aac5445-a8d5-463e-bd82-cb9d09a651dc'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.227855 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed046a1baa0410abbbbc1fef389910c', 'request_id': 'req-3aac5445-a8d5-463e-bd82-cb9d09a651dc'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.238525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] The token cache is being invalidate because project 4ed046a1baa0410abbbbc1fef389910c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:37.238817 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.239465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-3aac5445-a8d5-463e-bd82-cb9d09a651dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.241440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1360/2707] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:36 2022] DELETE /identity/v3/projects/4ed046a1baa0410abbbbc1fef389910c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:37.246397 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.246872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.246981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.267315 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:37.272169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.329614 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1348/2708] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:37.339165 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.339531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.339893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.359557 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:37.360766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.369119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1361/2709] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:37.373257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.383645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d131ab-6f9b-4361-a88c-19eca2f666ee None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.388235 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.388819 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.392648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.392648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.392648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:37.392648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.392648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.404364 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1349/2710] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:37.409600 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.419634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504382c7-d2be-453e-b594-c1a1a162be7d None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.424595 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.425195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.425476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.425748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.426423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.428328 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.499221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1362/2711] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:37.505729 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.516161 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13f41-2023-44f6-9cf2-71a70273684d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.572085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.572678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.572956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.573229 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.573840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.575765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.673169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1350/2712] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:37.674353 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.685384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408009d-32b4-45c6-b351-45bed0529055 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.690555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.691161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.691440 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.691713 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.692373 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.694565 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.705247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1363/2713] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:37.709131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.719212 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d8b3a-bf49-409c-aa22-d31ff187421d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.724800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.725424 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.725698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.725991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.726630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.728211 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2064f8c-d43f-4a0b-868d-d7636996a06a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.734099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:37.739755 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1351/2714] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:37.747381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.758253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca60b-9dc3-4116-88ec-b28285c0c1e0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.763279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.767346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.767346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.767346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] PATH_INFO: `/v3/projects/4da482b8503f41d5a902fb0ccf3a2cf7/users/16ec82fa2def454b88f41a609c4f1942/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.779806 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da482b8503f41d5a902fb0ccf3a2cf7, user_id=16ec82fa2def454b88f41a609c4f1942, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.782515 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.852211 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1364/2715] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:37 2022] PUT /identity/v3/projects/4da482b8503f41d5a902fb0ccf3a2cf7/users/16ec82fa2def454b88f41a609c4f1942/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:37.916689 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.917011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.917293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.945605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] MFA Rules not processed for user `16ec82fa2def454b88f41a609c4f1942`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:37.946840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:38.010598 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1352/2716] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:38.021534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:38.023564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:38.080369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05b84-b696-4287-b73f-6edafd646a4f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:38.083944 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:38.084537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:38.084839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:38.085110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:38.093235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:38.094679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32fe3a-f0cc-4a81-a39f-28b5193f8479 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:38.103769 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1365/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:38.123684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:38.189703 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a3c37-78fa-4170-bfe5-90a8fb78f332 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:38.194369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:38.194992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:38.195271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:38.195545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] PATH_INFO: `/v3/users/16ec82fa2def454b88f41a609c4f1942` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:38.196677 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ec82fa2def454b88f41a609c4f1942)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:38.198628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:38.351095 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ec82fa2def454b88f41a609c4f1942'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.358120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ec82fa2def454b88f41a609c4f1942'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.358808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ec82fa2def454b88f41a609c4f1942'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.359430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ec82fa2def454b88f41a609c4f1942'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.405680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ec82fa2def454b88f41a609c4f1942'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.424840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1353/2718] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:38 2022] DELETE /identity/v3/users/16ec82fa2def454b88f41a609c4f1942 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:38.429415 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:38.429699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:38.429998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:38.449317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:38.450528 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:38.470020 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:38.508892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1366/2719] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:38.518634 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:38.520060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:38.531536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:38.578169 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da31f-21ca-4b4d-846c-69709710b4e4 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:38.581844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:38.582466 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:38.582747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:38.583052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:38.592930 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:38.594886 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346841-4d2c-465f-b4d5-f0ff05c937a4 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:38.606450 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1354/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:38.995994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:38.998098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.016895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b1e02-0f3e-42cf-a0cd-3e12bc103025 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.022846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.023611 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.023883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.024186 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] PATH_INFO: `/v3/projects/4da482b8503f41d5a902fb0ccf3a2cf7` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.025295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da482b8503f41d5a902fb0ccf3a2cf7)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.027267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.132972 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da482b8503f41d5a902fb0ccf3a2cf7', 'request_id': 'req-dfea94c7-647c-4bd2-986b-e03463bae964'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.203466 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da482b8503f41d5a902fb0ccf3a2cf7', 'request_id': 'req-dfea94c7-647c-4bd2-986b-e03463bae964'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.209871 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da482b8503f41d5a902fb0ccf3a2cf7', 'request_id': 'req-dfea94c7-647c-4bd2-986b-e03463bae964'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.220562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] The token cache is being invalidate because project 4da482b8503f41d5a902fb0ccf3a2cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:39.220861 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.221496 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-dfea94c7-647c-4bd2-986b-e03463bae964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.223070 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1367/2721] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:38 2022] DELETE /identity/v3/projects/4da482b8503f41d5a902fb0ccf3a2cf7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:39.227988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.228277 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.228602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.248464 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:39.249670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.311163 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1355/2722] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:39.319679 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.319968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.320245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.339720 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:39.340949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.348901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1368/2723] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:39.353082 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.362939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871afd-8e9a-428a-b860-7be38df0dd1d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.368124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.368714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.368997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.369272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.369915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:39.370249 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.371832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.384005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1356/2724] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:39.388154 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.397703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689b193-3b77-4e1f-8db6-46992c1ca0fa None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.402459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.403041 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.403315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.403585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.404207 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.406299 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.499462 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1369/2725] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:39.503468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.514407 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89003a-2d90-4a06-a67d-0c809c39b29b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.570601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.571200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.571482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.571752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.572370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.574311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.686345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1357/2726] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:39.690657 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.704298 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614dc47-ad90-4193-a958-a09f700544b2 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.706603 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.707204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.707486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.707763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.708408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.710046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.719918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1370/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:39.724083 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.734761 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bcd8-9d85-4d9d-b9b1-e59b24e3f7ec admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.739379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.740509 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.740785 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.741054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.741721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.743330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392af39-eb6b-435f-aa5f-8eb9d5a65625 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.754014 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1358/2728] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:39.758015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.767963 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36aacb-06c3-4fa7-8e3f-00d534f43c92 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.772847 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.773484 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.773766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.774089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] PATH_INFO: `/v3/projects/2036419a5d9c4fa5b2b1e977b4239630/users/0711d0e3ad1642bba9fb64125c41fd99/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.790017 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2036419a5d9c4fa5b2b1e977b4239630, user_id=0711d0e3ad1642bba9fb64125c41fd99, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.792662 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.894979 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1371/2729] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:39 2022] PUT /identity/v3/projects/2036419a5d9c4fa5b2b1e977b4239630/users/0711d0e3ad1642bba9fb64125c41fd99/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:39.907074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.907358 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.907630 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.935481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] MFA Rules not processed for user `0711d0e3ad1642bba9fb64125c41fd99`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:39.936701 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.941621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:40.000159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1359/2730] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:40.011835 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.013522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:40.057128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:40.071264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f85cb-6e9f-478a-bce9-a6d63c48d839 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.074934 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.075537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.075812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.076089 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.085050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.086661 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f4a0e-cb63-4f22-a8f5-ae43a37a6614 service glance] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.095897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1372/2731] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:49.997686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=24 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:50.142221 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=8 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:11.720826 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:11.784401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953acad1-21b4-4d8d-bef6-087affd6f888 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:11.788904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:11.789539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:11.795055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:11.795055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] PATH_INFO: `/v3/users/0711d0e3ad1642bba9fb64125c41fd99` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:11.795055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0711d0e3ad1642bba9fb64125c41fd99)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:11.795055 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:11.983404 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0711d0e3ad1642bba9fb64125c41fd99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:11.990909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0711d0e3ad1642bba9fb64125c41fd99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:11.991578 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0711d0e3ad1642bba9fb64125c41fd99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:11.992187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0711d0e3ad1642bba9fb64125c41fd99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.077984 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0711d0e3ad1642bba9fb64125c41fd99'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.096056 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1360/2732] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:11 2022] DELETE /identity/v3/users/0711d0e3ad1642bba9fb64125c41fd99 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:12.100756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.101275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.101383 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.120734 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:12.121911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:12.178878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1373/2733] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:12.188640 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:12.190683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:12.249462 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8996-8e1b-47b5-aa8c-9f83258424ab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:12.253832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:12.254453 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.254728 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.254992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.264189 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:12.265596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a6f61-ed97-42f2-b936-44ba06b872e3 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:12.275848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1361/2734] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:12.632652 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:12.634989 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:12.654698 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0b108-ea38-4823-bd93-db42ef6cf5ae None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:12.663957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:12.663957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.663957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.663957 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] PATH_INFO: `/v3/projects/2036419a5d9c4fa5b2b1e977b4239630` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.664326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2036419a5d9c4fa5b2b1e977b4239630)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:12.664326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:12.758707 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2036419a5d9c4fa5b2b1e977b4239630', 'request_id': 'req-c55fd39d-d00b-4172-b194-e2427c25a6f7'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.815828 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2036419a5d9c4fa5b2b1e977b4239630', 'request_id': 'req-c55fd39d-d00b-4172-b194-e2427c25a6f7'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.822364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2036419a5d9c4fa5b2b1e977b4239630', 'request_id': 'req-c55fd39d-d00b-4172-b194-e2427c25a6f7'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.832684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] The token cache is being invalidate because project 2036419a5d9c4fa5b2b1e977b4239630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:12.832969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.833612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c55fd39d-d00b-4172-b194-e2427c25a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:12.835173 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1374/2735] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:12 2022] DELETE /identity/v3/projects/2036419a5d9c4fa5b2b1e977b4239630 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:12.840004 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.840479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.840587 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.859514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:12.860714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:12.878805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:12.920495 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1362/2736] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:12.928829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.929112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.929386 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.949637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:12.950967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:12.958748 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1375/2737] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:12.962812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:12.972463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a3661-05a1-41e1-83a9-79c5c39f636d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:12.976981 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:12.977560 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:12.977837 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:12.978141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:12.978778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:12.979074 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:12.980636 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:12.992356 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1363/2738] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:57:12.996342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.006404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c143dc1-e425-4cfd-8252-b3f5e5b5f281 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.011335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.011859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.012132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.012399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.013012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.014951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.089926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1376/2739] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:12 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:13.094181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.105064 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b7dff-ab4b-4522-875e-3a8f01884ee1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.160932 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.161533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.161814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.162121 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.162745 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.164635 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.243204 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1364/2740] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:13 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:13.247455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.258590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98def1bc-e525-495f-980f-7e994d011ee4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.265436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.265436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.265436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.265436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.265826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.266633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.276460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1377/2741] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:13.280258 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.290994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092b8-f8a2-48b1-a216-670f6403b3d3 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.295768 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.296362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.296670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.296944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.297625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.299921 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a6b6-ae3c-4bd0-873c-954cd284d660 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.310943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1365/2742] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:13.315144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.325319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0754f8-37d3-4fcb-af9f-178ddfb21cb5 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.330001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.330639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.330917 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.331190 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] PATH_INFO: `/v3/projects/77cb19531e1f43e5919b5e380284e835/users/523b46985f884ebc9fc282fd1bcdcd27/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.346437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cb19531e1f43e5919b5e380284e835, user_id=523b46985f884ebc9fc282fd1bcdcd27, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.349189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.408823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1378/2743] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:13 2022] PUT /identity/v3/projects/77cb19531e1f43e5919b5e380284e835/users/523b46985f884ebc9fc282fd1bcdcd27/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:13.420232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.420516 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.420794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.447860 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] MFA Rules not processed for user `523b46985f884ebc9fc282fd1bcdcd27`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:13.449068 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:13.512625 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1366/2744] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:13.524176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:13.525873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:13.548086 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:13.584342 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4844e-2eed-47d3-9e42-e6bbe100cc78 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:13.588048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:13.588677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:13.588960 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:13.589235 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:13.599590 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:13.603412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:13.610457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1379/2745] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:21.383106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:21.384604 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:21.404803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:21.443433 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de386a-a17d-4d43-bb59-990b21f81419 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:21.447223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:21.447827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:21.448107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:21.448381 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:21.450675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:21.541184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:21.542786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:21.563159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1367/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:22.746997 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.757229 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ff8d2-698e-452e-912d-84d9b7c3da66 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.760981 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.761571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.761853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.762232 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.764001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.778334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.779793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aae6ec-da9f-4f2c-be07-1bbd49f72ee8 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:22.790976 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1380/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:24.495529 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.496915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.511585 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186232d-d491-4ae2-b5e0-ddeb1c04ca33 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.517726 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.518371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.518651 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.518937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.520735 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.533778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.535421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.547977 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1368/2748] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:29.601549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:29.602275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:29.602275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:29.622006 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] MFA Rules not processed for user `a9722fb4f9d24b15b6f33ef1fc0550f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:29.623301 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:29.688463 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1381/2749] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:30.436202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:30.439592 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:30.519012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac7ed3-326e-4841-b53f-fac8352053ff service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:30.523964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:30.524565 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:30.524841 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:30.525110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:30.526882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:30.538691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:30.540256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:30.550638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1369/2750] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:33.839867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:33.842389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:33.858653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54c6-d776-465c-a850-bbd1feee5ffe None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:33.862381 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:33.862982 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:33.863349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:33.863552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:33.865292 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:33.876578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:33.878145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:33.889878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1382/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:40.545852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:41.372645 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:41.374389 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:41.393460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530701-b472-4358-8a33-dec46c9f2b72 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:41.399114 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:41.399707 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:41.400088 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:41.400337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:41.402076 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:41.414808 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:41.416312 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:41.427539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1370/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:43.883038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=54 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:45.765505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:45.779338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924651a1-c175-432c-9d0b-8e641678110b service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:45.785248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:45.786033 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:45.786376 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:45.786721 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:45.788639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:45.802614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:45.804236 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d37c-2205-4439-a4a5-7a61d3e97ae7 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:45.816309 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1383/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:51.083548 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.144966 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1e2de-be8f-4103-adba-88eb5f6781d7 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.149563 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.150210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.150490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.150845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] PATH_INFO: `/v3/users/523b46985f884ebc9fc282fd1bcdcd27` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.151957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523b46985f884ebc9fc282fd1bcdcd27)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.153864 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.323525 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523b46985f884ebc9fc282fd1bcdcd27'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.331365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523b46985f884ebc9fc282fd1bcdcd27'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.332040 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523b46985f884ebc9fc282fd1bcdcd27'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.332657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523b46985f884ebc9fc282fd1bcdcd27'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.406782 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523b46985f884ebc9fc282fd1bcdcd27'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.426301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1371/2754] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:51 2022] DELETE /identity/v3/users/523b46985f884ebc9fc282fd1bcdcd27 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:51.430811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.431289 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.431399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.450949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:51.452839 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:51.511167 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1384/2755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:51.521513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.522964 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:51.579567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60db3ac-7ccf-449d-babc-f6a6e87883f1 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.583111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.583704 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.583978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.584245 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.593190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.594706 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.604109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1372/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:52.010022 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.012082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.030313 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a2f2-6aab-47b7-896e-63b48e47ac24 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.035905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.036548 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.036826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.037087 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] PATH_INFO: `/v3/projects/77cb19531e1f43e5919b5e380284e835` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.038247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cb19531e1f43e5919b5e380284e835)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.040274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.142846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cb19531e1f43e5919b5e380284e835', 'request_id': 'req-2118314b-5301-4e83-a703-6dccc472d764'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:52.218275 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cb19531e1f43e5919b5e380284e835', 'request_id': 'req-2118314b-5301-4e83-a703-6dccc472d764'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:52.224740 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cb19531e1f43e5919b5e380284e835', 'request_id': 'req-2118314b-5301-4e83-a703-6dccc472d764'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:52.235951 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] The token cache is being invalidate because project 77cb19531e1f43e5919b5e380284e835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:52.236241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:52.236876 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:52.238413 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1385/2757] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:52 2022] DELETE /identity/v3/projects/77cb19531e1f43e5919b5e380284e835 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:01.599917 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:02.232403 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:50.545896 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:50.547330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:50.620350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6fff-632c-4c32-a701-c79c5c7a787c service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:50.682985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:50.683596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:50.683874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:50.684148 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:50.685880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:50.747170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:50.748723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:50.758451 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1373/2758] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:00.754118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=84 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:15.173844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:15.175276 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:15.230919 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118314b-5301-4e83-a703-6dccc472d764 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:15.235001 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:15.235585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.235860 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.236125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.237826 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:15.298429 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:15.299854 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:15.309379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1386/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:18.748505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.753265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.840482 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e1558-d9df-4eb1-8fe6-d14a9523d9be service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.845909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.846546 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.846827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.847098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.848858 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.861236 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.862882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.873160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1374/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:18.901983 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.903504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.917813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749b077-8d04-46cb-bd67-46612d197f5f service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.923103 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.925206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.925206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.925206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] PATH_INFO: `/v3/users/a9722fb4f9d24b15b6f33ef1fc0550f6` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.925571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9722fb4f9d24b15b6f33ef1fc0550f6)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.927368 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.133670 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9722fb4f9d24b15b6f33ef1fc0550f6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.134334 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9722fb4f9d24b15b6f33ef1fc0550f6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.141199 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9722fb4f9d24b15b6f33ef1fc0550f6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.141822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9722fb4f9d24b15b6f33ef1fc0550f6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.154238 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-7cfb3394-b40b-4af6-8964-383bc2b596e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9722fb4f9d24b15b6f33ef1fc0550f6'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.243099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1387/2761] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:18 2022] DELETE /identity/v3/users/a9722fb4f9d24b15b6f33ef1fc0550f6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:19.492392 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.503305 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319036b-929b-4889-9e90-e7574c670cf0 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.563822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.564439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.564717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.564990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] PATH_INFO: `/v3/projects/20fc70cc672347dc83dda154b3f75d51` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.566159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fc70cc672347dc83dda154b3f75d51)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.568033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.668244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fc70cc672347dc83dda154b3f75d51', 'request_id': 'req-468b599a-7061-452e-a087-44d027564a6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.674031 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fc70cc672347dc83dda154b3f75d51', 'request_id': 'req-468b599a-7061-452e-a087-44d027564a6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.680530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fc70cc672347dc83dda154b3f75d51', 'request_id': 'req-468b599a-7061-452e-a087-44d027564a6b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.756628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] The token cache is being invalidate because project 20fc70cc672347dc83dda154b3f75d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:19.757205 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.757586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-468b599a-7061-452e-a087-44d027564a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:19.759203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1375/2762] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:19 2022] DELETE /identity/v3/projects/20fc70cc672347dc83dda154b3f75d51 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:19.764357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.765228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.765513 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.786171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:19.787392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:19.804040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:19.847929 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1388/2763] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:19.856038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.856326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.856612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.876226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:19.877434 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:19.885498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1376/2764] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:19.890571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.900671 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf61e-da83-4e12-95f3-186041614bf2 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.906324 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.906898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.907129 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.907399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.908045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:19.908387 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.910007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.922012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1389/2765] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:19.926271 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.935657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fd0cf-49c4-4ced-a676-d9924540886a None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.940372 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.941222 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.941503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.941776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.942449 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.944344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.957034 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:20.062465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1377/2766] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:19 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:20.066568 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.076761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8847-389b-47cb-90a2-71f3ae2df6e0 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.132737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.133337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.133618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.133892 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.134542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.136455 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.262245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1390/2767] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:20 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:20.266937 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.277411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2b17-6f85-43df-a65b-5940c0502685 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.282107 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.282699 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.282980 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.283254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.283887 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.285474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.295493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1378/2768] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:20.303039 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.313741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189052a-448b-4c62-8d3e-72fe328866ce admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.318456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.319038 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.319317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.319588 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.320226 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.321811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a499d-9018-4eff-bb83-63039274d197 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.332843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1391/2769] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:59:20.336825 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.347319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe10c-1376-4a45-a897-ce4699fb055c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.351988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.352632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.352913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.353190 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] PATH_INFO: `/v3/projects/7b7ba77dda4247439d9b7d932713cc12/users/06fb4054f49d48c58d5127ab57782a94/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.367536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7ba77dda4247439d9b7d932713cc12, user_id=06fb4054f49d48c58d5127ab57782a94, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.370207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.473167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1379/2770] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:20 2022] PUT /identity/v3/projects/7b7ba77dda4247439d9b7d932713cc12/users/06fb4054f49d48c58d5127ab57782a94/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:20.485091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.485372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.485643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.514476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] MFA Rules not processed for user `06fb4054f49d48c58d5127ab57782a94`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:20.515703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:20.579421 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1392/2771] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:59:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:20.583848 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.645444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238c07c-70c1-49a8-b4cb-f2a58199695f admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.650168 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.650794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.651101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.651377 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.652010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.653962 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.766138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1380/2772] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:20 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:59:20.770283 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.781706 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bea6a-de1d-40a5-907f-887ce0c09ab8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.794361 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:20.839633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.840176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.840456 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.840729 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.841359 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.843896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.913459 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1393/2773] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:20 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:20.917588 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.928523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f0b3b-17fb-40a8-aaa5-bf7be2d6d62c admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.933120 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.936099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.936099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.936099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.936099 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.936522 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.948369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1381/2774] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:20.952735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:20.963192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33467-272c-4aab-92c0-ea4e98b73c6f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:20.968961 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:20.969606 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:20.970714 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:20.971002 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] PATH_INFO: `/v3/projects/8d913f83b0b9461782823e55ca4e4f98/users/f54556030174410b812b739d9de547af/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.987418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d913f83b0b9461782823e55ca4e4f98, user_id=f54556030174410b812b739d9de547af, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.990078 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:21.072251 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1394/2775] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:20 2022] PUT /identity/v3/projects/8d913f83b0b9461782823e55ca4e4f98/users/f54556030174410b812b739d9de547af/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:21.076363 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:21.089022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c28ce-a880-4f26-90b2-12f3df8a73f5 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:21.146160 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:21.146763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:21.147043 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:21.147333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:21.147956 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:21.149668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0f162-ff5a-4e17-9f5a-4a062add173d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:21.160109 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1382/2776] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:21.164239 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:21.175225 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e052e-c34c-4f4b-a165-c6ce406140e1 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:21.179943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:21.180593 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:21.180873 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:21.181147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] PATH_INFO: `/v3/projects/8d913f83b0b9461782823e55ca4e4f98/users/f54556030174410b812b739d9de547af/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:21.183122 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d913f83b0b9461782823e55ca4e4f98, user_id=f54556030174410b812b739d9de547af, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:21.185733 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:21.196059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1395/2777] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:21 2022] PUT /identity/v3/projects/8d913f83b0b9461782823e55ca4e4f98/users/f54556030174410b812b739d9de547af/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:21.206721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:21.207012 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:21.208465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:21.238880 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] MFA Rules not processed for user `f54556030174410b812b739d9de547af`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:21.240191 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:21.253400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:21.313435 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1383/2778] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:21.325642 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:21.328074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:21.399057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3f11-d9ca-46b5-9081-54504cf0b64d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:21.402738 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:21.403335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:21.403612 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:21.403887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:21.414812 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:21.416300 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:21.426476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1396/2779] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:21.603976 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:21.614474 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbab61-e433-41a9-bb53-f8ef615c2de3 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:21.618176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:21.618779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:21.619060 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:21.619333 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:21.680035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:21.681390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7619a-1d80-4d36-ab0c-7ac1a5ff3dae service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:21.690835 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1384/2780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:31.422018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:31.686193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=50 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:59.650475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:59.714010 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13629-5e98-4411-bf4a-72f08a929891 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:59.718577 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:59.719205 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:59.719485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:59.719761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] PATH_INFO: `/v3/users/06fb4054f49d48c58d5127ab57782a94` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:59.720884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fb4054f49d48c58d5127ab57782a94)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:59.722843 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:59.907032 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fb4054f49d48c58d5127ab57782a94'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:59.907694 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fb4054f49d48c58d5127ab57782a94'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:59.914838 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fb4054f49d48c58d5127ab57782a94'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:59.915522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fb4054f49d48c58d5127ab57782a94'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:59.927506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fb4054f49d48c58d5127ab57782a94'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.006918 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1397/2781] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:59 2022] DELETE /identity/v3/users/06fb4054f49d48c58d5127ab57782a94 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:00.011934 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:00.012412 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:00.012520 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:00.031763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:00.033049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:00.090967 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1385/2782] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:00.100783 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:00.102191 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:00.162351 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e89d-b109-417b-bbec-24246fa6583f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:00.165808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:00.166430 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:00.166705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:00.166994 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:00.175872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:00.177291 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:00.187219 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1398/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:00.648721 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:00.650344 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:00.663226 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0c321-58b4-4423-af40-cabf413b3a5e None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:00.668317 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:00.669053 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:00.669468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:00.669849 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] PATH_INFO: `/v3/projects/7b7ba77dda4247439d9b7d932713cc12` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:00.670913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7ba77dda4247439d9b7d932713cc12)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:00.672986 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:00.780049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7ba77dda4247439d9b7d932713cc12', 'request_id': 'req-965f094f-d0be-4aca-a09e-51f63975d133'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.785523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7ba77dda4247439d9b7d932713cc12', 'request_id': 'req-965f094f-d0be-4aca-a09e-51f63975d133'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.791711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7ba77dda4247439d9b7d932713cc12', 'request_id': 'req-965f094f-d0be-4aca-a09e-51f63975d133'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.857709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] The token cache is being invalidate because project 7b7ba77dda4247439d9b7d932713cc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:00.858022 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.858656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:00.860170 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1386/2784] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:00 2022] DELETE /identity/v3/projects/7b7ba77dda4247439d9b7d932713cc12 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:00.864218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:00.874666 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183c40-b2c2-4dc2-8c89-66ff1017b6bb service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:00.893107 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:00.930151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:00.930773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:00.931054 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:00.931325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] PATH_INFO: `/v3/users/f54556030174410b812b739d9de547af` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:00.932939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54556030174410b812b739d9de547af)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:00.935015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:01.207418 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54556030174410b812b739d9de547af'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.208080 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54556030174410b812b739d9de547af'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.215263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54556030174410b812b739d9de547af'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.215909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54556030174410b812b739d9de547af'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.227625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-e0f3333d-a28d-4feb-8fe8-5fde44f5fe55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54556030174410b812b739d9de547af'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.290295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1399/2785] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:00 2022] DELETE /identity/v3/users/f54556030174410b812b739d9de547af => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:01.688628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:01.690181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:01.703779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f094f-d0be-4aca-a09e-51f63975d133 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:01.762610 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:01.763246 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:01.763528 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:01.763805 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] PATH_INFO: `/v3/projects/8d913f83b0b9461782823e55ca4e4f98` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:01.764925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d913f83b0b9461782823e55ca4e4f98)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:01.766867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:01.892514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:01.908730 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d913f83b0b9461782823e55ca4e4f98', 'request_id': 'req-d670ea41-e65a-4032-ae3f-6104d33f08b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.914110 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d913f83b0b9461782823e55ca4e4f98', 'request_id': 'req-d670ea41-e65a-4032-ae3f-6104d33f08b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:01.920354 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d913f83b0b9461782823e55ca4e4f98', 'request_id': 'req-d670ea41-e65a-4032-ae3f-6104d33f08b1'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:02.038979 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] The token cache is being invalidate because project 8d913f83b0b9461782823e55ca4e4f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:02.039197 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:02.039872 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d670ea41-e65a-4032-ae3f-6104d33f08b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:02.041371 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1387/2786] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:01 2022] DELETE /identity/v3/projects/8d913f83b0b9461782823e55ca4e4f98 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:02.046536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.047018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.047151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.066902 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:02.068112 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:02.127098 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1400/2787] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:02.135112 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.135922 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.136198 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.156458 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:02.157646 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:02.165567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1388/2788] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:02.171582 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.179307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf2c05-eaf7-4713-9a76-eab06f6fad07 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.183888 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.184475 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.184754 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.185026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.185675 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:02.186081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.187677 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.199852 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1401/2789] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:02.203901 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.213176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d5942-c9fd-40e2-9291-984c4c3769ac None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.218513 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.219100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.219384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.219660 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.220293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.222239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.351028 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1389/2790] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:02.355142 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.365265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de66b6-3ecd-412b-8753-e807c7cf810e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.392633 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:02.422464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.423059 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.423338 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.423617 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.424243 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.426180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.513962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1402/2791] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:02.518134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.528421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0026f0-4c29-463c-a175-a789b9b875b0 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.533011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.533596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.533876 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.534181 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.534822 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.536402 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.546193 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1390/2792] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:02.549891 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.560491 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528953a4-9ecf-4d78-ab96-927d667e4e3c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.565153 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.565746 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.566265 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.566724 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.567743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.569389 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9747d7f-7030-4ea6-90c2-cb3848e6fc4c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.580045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1403/2793] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:02.584652 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.595617 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920220-ec32-40ec-a074-aeededf6db7b admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.600244 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.600883 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.601217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.601439 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] PATH_INFO: `/v3/projects/b780d59d01184d41a0bc3b2b8def4b85/users/55dda9c1854443a5beaf73aeb9661284/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.617116 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b780d59d01184d41a0bc3b2b8def4b85, user_id=55dda9c1854443a5beaf73aeb9661284, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.620291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:02.788384 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1391/2794] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:02 2022] PUT /identity/v3/projects/b780d59d01184d41a0bc3b2b8def4b85/users/55dda9c1854443a5beaf73aeb9661284/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:02.799325 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.799649 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.799930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.829134 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] MFA Rules not processed for user `55dda9c1854443a5beaf73aeb9661284`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:02.830441 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:02.893897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1404/2795] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:00:02.898382 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:02.958758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e03b9-2d85-4046-8e8a-7611fc190fe8 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:02.963629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:02.964221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.964501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.964772 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.965398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:02.967309 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.054100 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1392/2796] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:03.058141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.068914 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68231-4a9d-4a76-90fb-e69cfb96c82b None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.128322 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.128924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.129209 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.129478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.130128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.132046 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.230050 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1405/2797] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:03 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:03.234054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.244425 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a9350-595e-4d2e-ade0-f6bdd3adfa68 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.249042 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.249627 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.249903 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.250208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.250839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.252455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.262923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1393/2798] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:03.266971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.277281 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbee7a-1ca5-4f3c-85ee-07a7b5f64e2a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.281883 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.282538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.282813 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.283083 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] PATH_INFO: `/v3/projects/c42da9b0d1eb441f877cb3da49a25005/users/34777816e4ec4b0f8ecd5f3896984a4a/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.298357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42da9b0d1eb441f877cb3da49a25005, user_id=34777816e4ec4b0f8ecd5f3896984a4a, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.301069 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.360653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1406/2799] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:03 2022] PUT /identity/v3/projects/c42da9b0d1eb441f877cb3da49a25005/users/34777816e4ec4b0f8ecd5f3896984a4a/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:03.370330 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.380748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e73ed-a5b4-4722-b1b8-5e0d44bda4de admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.400719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.437827 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.438490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.438776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.439050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.439686 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.441262 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7bdb4-5d44-40de-a9d8-7acffeeed471 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.450748 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1394/2800] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:03.454894 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.460326 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.465890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752d38-b960-4721-9d01-50f4d56d4898 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.470586 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.471125 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.471400 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.471672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] PATH_INFO: `/v3/projects/c42da9b0d1eb441f877cb3da49a25005/users/34777816e4ec4b0f8ecd5f3896984a4a/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.473587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42da9b0d1eb441f877cb3da49a25005, user_id=34777816e4ec4b0f8ecd5f3896984a4a, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.476259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.488830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1407/2801] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:03 2022] PUT /identity/v3/projects/c42da9b0d1eb441f877cb3da49a25005/users/34777816e4ec4b0f8ecd5f3896984a4a/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:03.498756 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.499049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.499340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.526480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] MFA Rules not processed for user `34777816e4ec4b0f8ecd5f3896984a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:03.535741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.595878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1395/2802] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:03.607637 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.609417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.667113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de961d3-6d96-4095-abbe-75f7b22220ac admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.670798 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.671399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.671674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.671939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.681042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.683177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc95659-abd8-476e-93c7-d68bf2ebf4e0 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.692799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1408/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:03.758253 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.820137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f433-c13c-43fb-a9fe-7af447e1fb4d None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.825727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.826395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.826674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.826947 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] PATH_INFO: `/v3/users/55dda9c1854443a5beaf73aeb9661284` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.828118 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dda9c1854443a5beaf73aeb9661284)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.830102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.064688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dda9c1854443a5beaf73aeb9661284'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.065790 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.071724 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dda9c1854443a5beaf73aeb9661284'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.073006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dda9c1854443a5beaf73aeb9661284'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.073623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dda9c1854443a5beaf73aeb9661284'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.138293 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dda9c1854443a5beaf73aeb9661284'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.157155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1396/2804] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:03 2022] DELETE /identity/v3/users/55dda9c1854443a5beaf73aeb9661284 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:04.161643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.162179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.162287 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.181267 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:04.184672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:04.240547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1409/2805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:00:04.250727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.252155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:04.308786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcf55-c90e-4b6c-8cdb-b45d826184bb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.312378 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.312974 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.313257 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.313533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.322472 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.323847 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.333135 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1397/2806] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:04.762505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.764216 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:04.778629 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814b4d6-a22a-456a-9a7c-61c18dcdf5b6 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.783895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.784774 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.785180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.785594 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] PATH_INFO: `/v3/projects/b780d59d01184d41a0bc3b2b8def4b85` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.787036 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b780d59d01184d41a0bc3b2b8def4b85)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.789347 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.893198 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b780d59d01184d41a0bc3b2b8def4b85', 'request_id': 'req-05fbcfa0-f983-4abf-a8ca-197bc93c5826'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.954952 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b780d59d01184d41a0bc3b2b8def4b85', 'request_id': 'req-05fbcfa0-f983-4abf-a8ca-197bc93c5826'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.961643 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b780d59d01184d41a0bc3b2b8def4b85', 'request_id': 'req-05fbcfa0-f983-4abf-a8ca-197bc93c5826'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.972773 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] The token cache is being invalidate because project b780d59d01184d41a0bc3b2b8def4b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:04.973060 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.973681 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:04.975197 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1410/2807] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:04 2022] DELETE /identity/v3/projects/b780d59d01184d41a0bc3b2b8def4b85 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:04.979144 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.988923 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c776b4-757c-41f7-b2b4-f224a3f978cd service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.045200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.045839 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.046150 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.046457 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] PATH_INFO: `/v3/users/34777816e4ec4b0f8ecd5f3896984a4a` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.047613 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34777816e4ec4b0f8ecd5f3896984a4a)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.049576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.214350 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34777816e4ec4b0f8ecd5f3896984a4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:05.221044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34777816e4ec4b0f8ecd5f3896984a4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:05.222337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34777816e4ec4b0f8ecd5f3896984a4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:05.222337 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34777816e4ec4b0f8ecd5f3896984a4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:05.292267 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-5bb452bb-0541-406a-b739-ea6b9fd52806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34777816e4ec4b0f8ecd5f3896984a4a'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:05.297723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.311920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1398/2808] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:04 2022] DELETE /identity/v3/users/34777816e4ec4b0f8ecd5f3896984a4a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:05.748731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.750208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:05.764084 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbcfa0-f983-4abf-a8ca-197bc93c5826 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.778705 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.823881 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.824523 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.824837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.825110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] PATH_INFO: `/v3/projects/c42da9b0d1eb441f877cb3da49a25005` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.826375 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42da9b0d1eb441f877cb3da49a25005)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.828344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.953023 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42da9b0d1eb441f877cb3da49a25005', 'request_id': 'req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:06.073171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42da9b0d1eb441f877cb3da49a25005', 'request_id': 'req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:06.080007 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42da9b0d1eb441f877cb3da49a25005', 'request_id': 'req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:06.091968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] The token cache is being invalidate because project c42da9b0d1eb441f877cb3da49a25005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:06.091968 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:06.092655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b41784a6-d04b-43ec-b7b7-5aa5f1dde182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:06.094208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1411/2809] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:05 2022] DELETE /identity/v3/projects/c42da9b0d1eb441f877cb3da49a25005 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:06.099102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.099586 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.099695 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.119655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:06.120854 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:06.181291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1399/2810] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:06.189419 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.189704 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.190011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.209414 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:06.210887 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:06.219332 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1412/2811] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:06.223379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.233499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2372428-7123-4d5c-8a05-85ed70189098 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.238045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.238632 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.238913 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.239186 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.239832 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:06.240134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.241717 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.253005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1400/2812] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:06.257105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.266412 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f586d-e3c0-42ce-996e-208f3cea9325 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.271106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.271684 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.271967 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.272241 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.272868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.274821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.367110 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1413/2813] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:06 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:06.371405 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.381298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea77208-1680-4b8c-9fdf-6145cef27c61 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.437430 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.438054 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.438338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.438615 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.439232 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.441136 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.548573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1401/2814] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:06 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:06.552889 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.563341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730369-e188-4f54-9234-2923a1ea2501 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.568027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.568621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.568901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.569174 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.569856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.571471 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.582057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1414/2815] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:06.586383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.596960 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7de4-9586-4514-8bb4-bd0a95a5f9a9 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.601590 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.602208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.602486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.602758 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.603395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.604968 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44fdf5-f731-4048-a5d3-783bf255cc03 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.615390 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1402/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:06.619379 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.629248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3cd33-45b2-4c16-9355-05cda940f62e admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.633947 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.635149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.635426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.635763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] PATH_INFO: `/v3/projects/eeab16d2cec8431998f48abe09450dc1/users/2af4c499fbe84238852b49243494f9e9/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.651077 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeab16d2cec8431998f48abe09450dc1, user_id=2af4c499fbe84238852b49243494f9e9, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.653736 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.749224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1415/2817] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:06 2022] PUT /identity/v3/projects/eeab16d2cec8431998f48abe09450dc1/users/2af4c499fbe84238852b49243494f9e9/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:06.760184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.760481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.760741 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.788840 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] MFA Rules not processed for user `2af4c499fbe84238852b49243494f9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:06.790115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:06.830705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:06.853013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1403/2818] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:06.864133 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.865822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:06.912402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:06.944218 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275fdf-45a1-41c3-8e14-50cd8c601ba3 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.948680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.949278 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.949737 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.950437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.958543 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.959969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2902-16f3-4464-a229-14237f1086d0 service glance] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.968896 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1416/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:16.925494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=8 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:16.999958 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=16 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.344777 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.406295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319935-ec9a-4d34-8c72-083e5fc7a6dc None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.411037 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.411661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.411943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.412217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] PATH_INFO: `/v3/users/2af4c499fbe84238852b49243494f9e9` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.413338 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af4c499fbe84238852b49243494f9e9)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.415318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.569869 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af4c499fbe84238852b49243494f9e9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:26.577250 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af4c499fbe84238852b49243494f9e9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:26.577851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af4c499fbe84238852b49243494f9e9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:26.578492 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af4c499fbe84238852b49243494f9e9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:26.653714 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af4c499fbe84238852b49243494f9e9'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:26.671069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1404/2820] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:26 2022] DELETE /identity/v3/users/2af4c499fbe84238852b49243494f9e9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:26.675417 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.675893 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.676008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.697476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:26.698793 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:26.757307 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1417/2821] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:26.767468 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.768881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:26.826593 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423f7f-00d8-44da-aee8-36e3917f3fc6 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.830447 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.830987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.831322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.831605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.841537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.842985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fee65-f872-48b5-a590-1b802cb6322f service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.852426 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1405/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:27.287019 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:27.288808 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:27.302037 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0e912-6764-430a-9ce6-675ef675c303 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.307803 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.313104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.313104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.313104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] PATH_INFO: `/v3/projects/eeab16d2cec8431998f48abe09450dc1` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.313104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeab16d2cec8431998f48abe09450dc1)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.313104 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.419025 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeab16d2cec8431998f48abe09450dc1', 'request_id': 'req-fdca935d-a29b-4bb5-a54a-2567a08aade1'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:27.496869 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeab16d2cec8431998f48abe09450dc1', 'request_id': 'req-fdca935d-a29b-4bb5-a54a-2567a08aade1'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:27.503658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeab16d2cec8431998f48abe09450dc1', 'request_id': 'req-fdca935d-a29b-4bb5-a54a-2567a08aade1'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:27.514149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] The token cache is being invalidate because project eeab16d2cec8431998f48abe09450dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:27.514438 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:27.515064 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-fdca935d-a29b-4bb5-a54a-2567a08aade1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:27.516578 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1418/2823] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:27 2022] DELETE /identity/v3/projects/eeab16d2cec8431998f48abe09450dc1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:27.521494 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.522010 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.522128 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.541583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:27.542807 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:27.559868 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:27.602673 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1406/2824] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:27.667787 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.668072 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.668348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.687939 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:27.689056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:27.696942 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1419/2825] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:00:27.701210 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:27.711123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff63e01-bc12-4d38-b9a0-6eae2740d07c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.716266 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.716857 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.717137 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.717429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.718230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:27.718395 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.719973 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.731786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1407/2826] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:27.735878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:27.745449 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1e57-5790-4ce9-a25d-ee6dcae3959e None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.750176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.750765 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.751048 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.751319 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.751971 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.753859 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.832149 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1420/2827] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:27 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:00:27.836291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:27.846799 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4611a-b7cc-4d68-82db-aab5f3cb1756 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.901945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.902567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.902844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.903111 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.903718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.905602 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.985564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1408/2828] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:27 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:27.989571 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.000176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef604cd-8fe0-4e2e-bcbb-f4a673d7c60c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.004820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.005416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.005697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.006004 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.006651 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:28.008426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:28.018478 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1421/2829] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:28.027653 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.037659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c984c2e-1a7d-453c-8aec-9c74bf357feb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.042933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.043517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.043798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.044102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.044739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:28.046432 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf5545-538b-465d-a31e-e247384ad23e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:28.057108 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1409/2830] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:28.061170 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.071176 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cdbe3-ee63-4f07-a59c-22ff02f0888b admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.076279 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.081840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.081840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.081840 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] PATH_INFO: `/v3/projects/27d79d8d7c73431789ad08d6a5858918/users/9c960b954a3145a3818b0b4736fd252f/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.093404 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d79d8d7c73431789ad08d6a5858918, user_id=9c960b954a3145a3818b0b4736fd252f, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:28.096082 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:28.188454 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1422/2831] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:28 2022] PUT /identity/v3/projects/27d79d8d7c73431789ad08d6a5858918/users/9c960b954a3145a3818b0b4736fd252f/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:28.198939 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.199221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.202131 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.228411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] MFA Rules not processed for user `9c960b954a3145a3818b0b4736fd252f`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:28.229605 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:28.291485 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1410/2832] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:28.302180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.303868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:28.325621 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:28.360231 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb365-e7fd-40da-8166-099c0ab2c90f admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.364509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.365111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.365396 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.365680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.374566 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:28.376018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b6527-db3e-4e93-a4c6-2dd72fecb11e service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:28.384768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1423/2833] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:35.071657 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.092140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:35.134916 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538b767-14f2-488f-a7ba-5d98a08d8383 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.139945 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.140559 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.140867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.141138 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] PATH_INFO: `/v3/users/9c960b954a3145a3818b0b4736fd252f` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.142297 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c960b954a3145a3818b0b4736fd252f)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.144201 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.314990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c960b954a3145a3818b0b4736fd252f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:35.321746 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c960b954a3145a3818b0b4736fd252f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:35.322427 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c960b954a3145a3818b0b4736fd252f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:35.323753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c960b954a3145a3818b0b4736fd252f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:35.388881 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c960b954a3145a3818b0b4736fd252f'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:35.406797 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1411/2834] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:35 2022] DELETE /identity/v3/users/9c960b954a3145a3818b0b4736fd252f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:35.411423 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.411909 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.412009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.430870 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:35.432587 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:35.491189 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1424/2835] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:35.501597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.503003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:35.559661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da862575-8858-4114-b4fa-af6d3a568c48 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.563326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.563920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.564202 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.564478 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.573554 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.574944 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ed4f-2bda-43c9-82f4-ed558f035d20 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.584506 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1412/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:35.986756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.988447 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:36.000822 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6dda-dd19-4552-9f94-38dfac3b1239 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.006560 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.007193 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.007472 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.007743 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] PATH_INFO: `/v3/projects/27d79d8d7c73431789ad08d6a5858918` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.008866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d79d8d7c73431789ad08d6a5858918)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.011029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.149492 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d79d8d7c73431789ad08d6a5858918', 'request_id': 'req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:36.217506 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d79d8d7c73431789ad08d6a5858918', 'request_id': 'req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:36.224018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d79d8d7c73431789ad08d6a5858918', 'request_id': 'req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:36.235337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] The token cache is being invalidate because project 27d79d8d7c73431789ad08d6a5858918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:36.235620 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:36.236230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-54f9e66e-3e10-4a4b-bfd1-69f3d4330d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:36.237727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1425/2837] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:35 2022] DELETE /identity/v3/projects/27d79d8d7c73431789ad08d6a5858918 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:36.242549 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.243025 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.243124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.263326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:36.264530 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:36.303159 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:36.328908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1413/2838] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:00:36.336761 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.337040 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.337308 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.357392 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:36.358618 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:36.367105 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1426/2839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:36.371311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.380780 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ad2e7-2001-4acc-b34f-09b9340b90ba None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.385861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.386479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.386759 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.387050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.387691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:36.387991 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.389567 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.401607 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1414/2840] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:36.405910 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.415169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9a507-28e8-476b-b5ff-089d3a764b0a None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.419926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.420509 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.420785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.421114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.421731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.423680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.510634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1427/2841] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:36.514796 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.525155 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665994b-cee0-4527-9351-fb6372bfbacb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.580814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.581409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.581684 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.581978 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.582709 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.584622 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.699295 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1415/2842] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:36.703538 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.714344 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f0caa-c909-4ad9-a4a7-58aba9047f0d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.719057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.719644 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.719924 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.720196 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.720837 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.722596 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.732425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1428/2843] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:36.737928 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.748644 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ea65-24ce-40c7-af62-baad9e08e79a admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.753360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.754008 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.754291 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.754562 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.755203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.756787 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26b843-e4ce-4682-bb54-18d65e0c6e3b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.768002 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1416/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:36.771988 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:36.782045 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a135d-f377-4f48-a2d3-ee35b945940c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.786632 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.787270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.787550 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.787825 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] PATH_INFO: `/v3/projects/a22575c21d044d08aaef9a6d87440e88/users/c00ccc781ba6408fb10a56ca2bfb6f88/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.790029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:36.802915 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22575c21d044d08aaef9a6d87440e88, user_id=c00ccc781ba6408fb10a56ca2bfb6f88, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.805665 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.886631 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1429/2845] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:36 2022] PUT /identity/v3/projects/a22575c21d044d08aaef9a6d87440e88/users/c00ccc781ba6408fb10a56ca2bfb6f88/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:36.896888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.897172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.897444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.924955 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] MFA Rules not processed for user `c00ccc781ba6408fb10a56ca2bfb6f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:36.926227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:36.992844 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1417/2846] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:37.004511 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.006369 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.063481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357871e-65a9-4555-ae54-48611f67e9f4 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.067222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:37.067901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.068177 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.068446 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.076585 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:37.078678 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:37.088646 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1430/2847] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:37.410675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.412102 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.451647 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:37.482046 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa98ea-6034-4aa8-a8fe-171dbcbb8f8c None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.487203 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:37.487802 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.488085 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.488376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.490176 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.501469 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:37.503179 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b90e-eafd-4107-a80e-d63385d9344e service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:37.513069 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1418/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:40.129785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:40.191500 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888f74-8e3a-4b34-ac07-5c650bccb244 service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:40.195993 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:40.196607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:40.196911 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:40.197192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] PATH_INFO: `/v3/users/c00ccc781ba6408fb10a56ca2bfb6f88` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:40.198336 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00ccc781ba6408fb10a56ca2bfb6f88)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:40.200253 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:40.368420 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00ccc781ba6408fb10a56ca2bfb6f88'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:40.369562 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00ccc781ba6408fb10a56ca2bfb6f88'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:40.376517 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00ccc781ba6408fb10a56ca2bfb6f88'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:40.377152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00ccc781ba6408fb10a56ca2bfb6f88'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:40.389052 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00ccc781ba6408fb10a56ca2bfb6f88'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:40.449063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1431/2849] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:00:40 2022] DELETE /identity/v3/users/c00ccc781ba6408fb10a56ca2bfb6f88 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:40.453531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:40.454712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:40.454712 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:40.474655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:40.475859 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:40.533098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1419/2850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:40.543465 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:40.544884 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:40.551390 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:40.607356 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c345-18ec-4a31-8717-8de23aee9690 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:40.611240 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:40.611897 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:40.612357 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:40.612779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:40.626305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:40.626305 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d8462-9d47-43e5-b974-9c55ceb0ad11 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:40.637450 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1432/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:41.094051 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.095723 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.110180 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc1165-3fe1-4a4f-8d07-06f7d5fa3fe0 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.115006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.115676 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.115954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.116227 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] PATH_INFO: `/v3/projects/a22575c21d044d08aaef9a6d87440e88` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.117359 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22575c21d044d08aaef9a6d87440e88)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.119786 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.249996 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22575c21d044d08aaef9a6d87440e88', 'request_id': 'req-e2ee44eb-e07e-42db-a768-9aa91556900c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:41.255442 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22575c21d044d08aaef9a6d87440e88', 'request_id': 'req-e2ee44eb-e07e-42db-a768-9aa91556900c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:41.262272 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22575c21d044d08aaef9a6d87440e88', 'request_id': 'req-e2ee44eb-e07e-42db-a768-9aa91556900c'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:41.339536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] The token cache is being invalidate because project a22575c21d044d08aaef9a6d87440e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:00:41.339824 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:41.340446 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-e2ee44eb-e07e-42db-a768-9aa91556900c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:00:41.342000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1420/2852] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:00:41 2022] DELETE /identity/v3/projects/a22575c21d044d08aaef9a6d87440e88 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:41.346969 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.347445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.347552 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.366584 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:41.367766 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.425237 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1433/2853] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:41.433683 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.434000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.434283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.454545 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:41.455752 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.463648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1421/2854] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:41.467784 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.477372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb4f2c-bd64-423a-9395-f0ed405e58f8 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.482444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.483063 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.483341 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.483614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.484263 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:41.484564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.486172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.498162 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1434/2855] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:41.502220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.511216 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ece3c-899d-4feb-ae25-d8a803834869 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.515867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.516463 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.516727 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.516999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.517621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.519533 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.598576 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1422/2856] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:41.603228 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.613217 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59ee2-acc5-403b-bc1b-d16b706fcf2c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.669868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.670531 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.670811 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.671085 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] PATH_INFO: `/v3/users` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.671701 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.673639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.777220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1435/2857] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:41.781444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.792476 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6679954-20c9-48fb-937f-578cf41a2357 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.797218 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.797814 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.798149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.798455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.799098 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.800680 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.811213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1423/2858] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:41.815090 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.825000 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a46e-affc-42fa-9a97-d51eb578a673 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.829867 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.830481 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.830759 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.831056 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.831699 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.833349 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee92d-8f8f-496d-933f-e33c8489415b admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.843151 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1436/2859] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:00:41.847141 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.857376 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265f242-c3d1-42b1-ae2b-6bbdf779cb6d admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.861988 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.862638 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.862905 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.863184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] PATH_INFO: `/v3/projects/eca4c73ca48c4f569160408027b8a81d/users/029ef9b7cdeb4a1eb9e3d98260d972fc/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.866162 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:41.878115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca4c73ca48c4f569160408027b8a81d, user_id=029ef9b7cdeb4a1eb9e3d98260d972fc, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.880776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.988340 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1424/2860] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:00:41 2022] PUT /identity/v3/projects/eca4c73ca48c4f569160408027b8a81d/users/029ef9b7cdeb4a1eb9e3d98260d972fc/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:41.993436 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153a09-217b-4336-beb7-4d203251a65d None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.993747 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153a09-217b-4336-beb7-4d203251a65d None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.994057 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153a09-217b-4336-beb7-4d203251a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.012639 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-a5153a09-217b-4336-beb7-4d203251a65d None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:42.013872 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-a5153a09-217b-4336-beb7-4d203251a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:42.022101 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:42.073816 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1437/2861] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:42.083765 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:42.085480 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:42.143437 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889008-bfcb-4f40-9e34-0371af4b19ab admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.147233 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.147861 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.148145 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.148423 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.158058 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.159481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.170326 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1425/2862] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:43.422901 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c3f3-1033-4233-89f0-cc99e37d5098 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:43.423464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c3f3-1033-4233-89f0-cc99e37d5098 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:43.423464 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24c3f3-1033-4233-89f0-cc99e37d5098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:43.451614 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6e24c3f3-1033-4233-89f0-cc99e37d5098 None None] MFA Rules not processed for user `029ef9b7cdeb4a1eb9e3d98260d972fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:43.452841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6e24c3f3-1033-4233-89f0-cc99e37d5098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:43.518554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1438/2863] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:43.529564 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:43.531140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:43.589005 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a7719-6c0e-42bb-9ef3-7c7171fcf726 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:43.592661 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:43.593252 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:43.593531 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:43.593800 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:43.601994 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:43.604101 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:43.612915 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1426/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:45.411648 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639d8eb-f678-478c-89cc-d8a8aff9d00e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:45.412185 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639d8eb-f678-478c-89cc-d8a8aff9d00e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:45.412445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639d8eb-f678-478c-89cc-d8a8aff9d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:45.434542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1639d8eb-f678-478c-89cc-d8a8aff9d00e None None] MFA Rules not processed for user `029ef9b7cdeb4a1eb9e3d98260d972fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:45.435752 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1639d8eb-f678-478c-89cc-d8a8aff9d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:45.442658 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1439/2865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:00:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:00:45.675503 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:45.684998 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6533-e89b-4660-ba9e-949f664e4395 service cinder] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:45.689301 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:45.689908 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:45.690221 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:45.690491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:45.694670 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:45.706308 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:45.707749 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:45.716739 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1427/2866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:00:55.429081 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=56 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:55.712812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.744664 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb108d5-c074-4b92-a13a-d03fddb565c5 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.745152 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb108d5-c074-4b92-a13a-d03fddb565c5 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.745261 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb108d5-c074-4b92-a13a-d03fddb565c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.764141 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-adb108d5-c074-4b92-a13a-d03fddb565c5 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:24.765830 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-adb108d5-c074-4b92-a13a-d03fddb565c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:24.773625 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1440/2867] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:24.797678 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:24.799158 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:24.873455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a91c8-c787-4189-bda0-0bbe48f461a0 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:24.879322 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:24.879933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.880230 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.880501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.888771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:24.890414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:24.900321 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1428/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:30.063710 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be096-2939-4312-be81-29820a73cc62 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:30.064250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be096-2939-4312-be81-29820a73cc62 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:30.064250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0be096-2939-4312-be81-29820a73cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:30.084145 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-be0be096-2939-4312-be81-29820a73cc62 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:30.085346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-be0be096-2939-4312-be81-29820a73cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:30.093224 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1441/2869] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:30.114386 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:30.115856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:30.132346 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c95224-18a7-4d39-8b4f-4c18c1dbf32e service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:30.138517 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:30.139103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:30.139383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:30.139655 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:30.148013 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:30.149581 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:30.159134 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1429/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:33.711739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05d13-a510-4735-8822-3308fe7e8959 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:33.712194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05d13-a510-4735-8822-3308fe7e8959 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:33.712378 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05d13-a510-4735-8822-3308fe7e8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:33.732026 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-aab05d13-a510-4735-8822-3308fe7e8959 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:33.733250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-aab05d13-a510-4735-8822-3308fe7e8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:33.741719 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1442/2871] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:33.761489 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:33.772891 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d784a4-4c91-4dd7-88c5-3fa275137714 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:33.779050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:33.779629 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:33.779904 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:33.780172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:33.788123 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:33.789668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:33.799501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1430/2872] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:36.589823 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0737fc-0664-42b8-a154-0ef56217af8e None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.590337 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0737fc-0664-42b8-a154-0ef56217af8e None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.590457 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0737fc-0664-42b8-a154-0ef56217af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.609703 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-1f0737fc-0664-42b8-a154-0ef56217af8e None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:36.610931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-1f0737fc-0664-42b8-a154-0ef56217af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:36.618731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1443/2873] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:36.640526 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.651874 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88aae7-f4c2-4688-b196-85dd31b65651 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.657421 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.658035 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.658319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.658595 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.667124 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.668688 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.678597 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1431/2874] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:40.845998 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f13da-57ab-4a0e-bedc-f81c705afe08 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.846488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f13da-57ab-4a0e-bedc-f81c705afe08 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.846597 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f13da-57ab-4a0e-bedc-f81c705afe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.865460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c22f13da-57ab-4a0e-bedc-f81c705afe08 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:40.866683 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c22f13da-57ab-4a0e-bedc-f81c705afe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:40.874647 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1444/2875] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:40.899414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.911501 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1bfa3-c25d-43ff-a190-5905d6d19135 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:40.916999 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:40.919789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.919789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.919789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.926609 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.928217 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.937867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1432/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:45.084106 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd69c-e381-4536-a16d-6854c5a9db76 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.084605 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd69c-e381-4536-a16d-6854c5a9db76 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.084725 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd69c-e381-4536-a16d-6854c5a9db76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.104878 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-6b2cd69c-e381-4536-a16d-6854c5a9db76 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:45.110654 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-6b2cd69c-e381-4536-a16d-6854c5a9db76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:45.114856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1445/2877] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:45.147667 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:45.158902 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d58b6c-e1b1-4204-8d77-68dfaca27f18 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:45.167167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.167167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.167167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.167167 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.174414 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.176149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4585b-1d77-4201-9054-59d4ee08afa7 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.185583 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1433/2878] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:55.100066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=18 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.181324 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=64 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:02.463068 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:02.463564 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:02.463690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:02.485008 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] MFA Rules not processed for user `029ef9b7cdeb4a1eb9e3d98260d972fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:02.486230 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:02.494470 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1446/2879] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:02:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:12.480091 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:21.132987 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec34bc-de0b-414e-a6f7-bbd6a2b4da19 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:21.133556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec34bc-de0b-414e-a6f7-bbd6a2b4da19 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:21.133556 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec34bc-de0b-414e-a6f7-bbd6a2b4da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:21.153194 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-80ec34bc-de0b-414e-a6f7-bbd6a2b4da19 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:21.154429 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-80ec34bc-de0b-414e-a6f7-bbd6a2b4da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:21.162409 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1434/2880] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:21.181073 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:21.196422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d698c84-38c0-4023-ac16-babcb456d8d9 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:21.201820 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:21.202451 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:21.202726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:21.202995 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:21.211696 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:21.213264 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:21.222534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1447/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:24.705140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0ea4b-34eb-4783-9960-63bbf8d1c65a None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:24.709403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0ea4b-34eb-4783-9960-63bbf8d1c65a None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:24.709403 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0ea4b-34eb-4783-9960-63bbf8d1c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:24.726172 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-43a0ea4b-34eb-4783-9960-63bbf8d1c65a None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:24.727411 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-43a0ea4b-34eb-4783-9960-63bbf8d1c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:24.735220 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1435/2882] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:24.755645 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:24.767018 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19187f01-0b6c-4098-ae31-5742cc9d555c service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:24.773256 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:24.773846 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:24.774160 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:24.774437 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:24.782535 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:24.784111 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:24.793486 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1448/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:28.598608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653390-9662-44a2-9777-2afa8a1a8001 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:28.599156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653390-9662-44a2-9777-2afa8a1a8001 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:28.599156 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653390-9662-44a2-9777-2afa8a1a8001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:28.622011 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-e3653390-9662-44a2-9777-2afa8a1a8001 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:28.623493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-e3653390-9662-44a2-9777-2afa8a1a8001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:28.632693 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1436/2884] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:28.654575 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:28.665844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa4417-1e8f-45aa-814f-5ef02e3bc061 service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:28.671312 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:28.671936 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:28.672248 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:28.672522 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:28.682536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:28.689763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:28.694579 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1449/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:32.867740 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:32.868319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:32.868319 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:32.888401 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:32.889582 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:32.897361 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1437/2886] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:32.929799 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:32.941364 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7ceba-148f-4b8f-ab04-c64a41733ffc service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:32.946868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:32.947460 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:32.947785 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:32.948015 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:32.956113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:32.957690 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa2242-8dbc-44c9-8ffc-59e8ce1415f5 service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:32.967027 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1450/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:34.190626 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:34.192149 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:34.204041 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8cc5-cbec-44d6-8758-acf20e47a06b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:34.207601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:34.208213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:34.208488 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:34.208754 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:34.210568 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:34.219833 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:34.221239 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:34.229541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1438/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:37.124505 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:37.125100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:37.125100 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:37.144931 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:37.146801 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:37.155009 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1451/2889] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Aug 24 04:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:02:37.179298 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:37.193811 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ce44-c011-4ce9-96f7-d317e460bfe1 service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:37.199566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:37.200106 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:37.200383 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:37.200656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:37.209954 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:37.211539 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:37.222336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1439/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:41.246574 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:41.256549 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6927015-8a10-429d-9c98-80a8f361ec25 None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:41.260259 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634e36d89a344c1a87946891dbdbbfa2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:41.260853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:41.261132 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:41.261428 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:41.263201 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:41.277416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:41.279868 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:41.290824 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1452/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:45.293000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:45.297486 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=25 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:45.305367 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5674410-5885-466a-af6c-8ed89824845e service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:45.309851 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:45.314618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:45.314618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:45.314618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:45.314618 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:45.327490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:45.328888 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:45.340327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1440/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:48.961613 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:48.967452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=34 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:48.973179 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afdb3-7d14-41f6-a20f-53a602dd0c9f service cinder] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:48.978833 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:48.979422 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:48.979697 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:48.979962 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:48.981711 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:48.994295 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:48.995853 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:49.006916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1453/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:02:55.336265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=5 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:59.174521 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=5 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:14.106020 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:14.118416 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb088-7da9-49f4-b10f-bf9a58c6a54a service neutron] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:14.128508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:14.128508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.128508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.128508 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] PATH_INFO: `/v3/users/029ef9b7cdeb4a1eb9e3d98260d972fc` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.128953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029ef9b7cdeb4a1eb9e3d98260d972fc)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:14.128953 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:14.358893 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029ef9b7cdeb4a1eb9e3d98260d972fc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.365753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029ef9b7cdeb4a1eb9e3d98260d972fc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.366498 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029ef9b7cdeb4a1eb9e3d98260d972fc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.367747 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029ef9b7cdeb4a1eb9e3d98260d972fc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.436666 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d93b4ed2-c0a5-4c20-aafa-144a23933397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029ef9b7cdeb4a1eb9e3d98260d972fc'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.454444 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1441/2894] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:03:14 2022] DELETE /identity/v3/users/029ef9b7cdeb4a1eb9e3d98260d972fc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:14.712841 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:14.724655 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc527-177a-49cf-a240-e9e5570e9d3f service nova] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:14.782501 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:14.783128 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.783408 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.783680 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] PATH_INFO: `/v3/projects/eca4c73ca48c4f569160408027b8a81d` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.784964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca4c73ca48c4f569160408027b8a81d)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:14.787011 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:14.883065 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca4c73ca48c4f569160408027b8a81d', 'request_id': 'req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.948938 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca4c73ca48c4f569160408027b8a81d', 'request_id': 'req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.956727 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca4c73ca48c4f569160408027b8a81d', 'request_id': 'req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.968476 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] The token cache is being invalidate because project eca4c73ca48c4f569160408027b8a81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:03:14.968768 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.969411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-20fbefee-6fc3-4e48-a13f-a6d0cd36dbd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:14.970941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1454/2895] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:14 2022] DELETE /identity/v3/projects/eca4c73ca48c4f569160408027b8a81d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:14.975951 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.976259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.976555 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.996438 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:14.997648 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:15.057455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1442/2896] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:15.066555 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.066863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.067166 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.088741 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:15.090012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:15.097821 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1455/2897] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:03:15.101852 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.111398 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e247-0d2d-44c0-ae62-88ca33f4e9ed None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.115914 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.116499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.116778 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.117050 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.117691 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81741) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:15.118018 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.119596 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.130792 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1443/2898] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 24 04:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:15.135425 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.144735 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4653664-ffeb-4b54-9718-c1a0bda504df None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.150012 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.150602 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.150885 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.151161 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.151795 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.153688 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.271791 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1456/2899] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:03:15.275831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.285831 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1216b-1d67-441d-9af0-f24e8a2a63eb admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.341536 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.342175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.342460 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.342737 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.343379 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.345279 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.352997 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:15.470675 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1444/2900] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:03:15 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:03:15.475003 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.485674 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d9d5-66a1-49ca-b376-edde1324eeeb admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.490346 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.490937 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.491215 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.491487 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.492335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.494088 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.504047 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1457/2901] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:03:15.508282 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.518348 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8b50-4ef9-4a6a-adb1-be532a0e427e admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.523720 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.524256 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.524537 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.524812 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] PATH_INFO: `/v3/roles` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.525455 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.527175 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765d18a-61d0-4f7a-8d5e-c0009f76630d admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.538483 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1445/2902] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:03:15.543246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.553178 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f408-a460-48ae-bdd9-1a33cb309e85 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.557726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.558397 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.558676 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.558949 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] PATH_INFO: `/v3/projects/3a06de4e61a34824800174b12ce9d3c8/users/b1f96ff69658433ab596534282a3a2ea/roles/a173a3f73a994a4ba4a5df3459bfb165` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.573355 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a06de4e61a34824800174b12ce9d3c8, user_id=b1f96ff69658433ab596534282a3a2ea, role_id=a173a3f73a994a4ba4a5df3459bfb165)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.576042 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.637435 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1458/2903] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:03:15 2022] PUT /identity/v3/projects/3a06de4e61a34824800174b12ce9d3c8/users/b1f96ff69658433ab596534282a3a2ea/roles/a173a3f73a994a4ba4a5df3459bfb165 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:15.643479 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869072c0-dddd-44ca-82be-6b8ec128a851 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.643783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869072c0-dddd-44ca-82be-6b8ec128a851 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.644063 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869072c0-dddd-44ca-82be-6b8ec128a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.663505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-869072c0-dddd-44ca-82be-6b8ec128a851 None None] MFA Rules not processed for user `04db7b67b37f41558e8d4c57ad2b3f70`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:15.664774 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-869072c0-dddd-44ca-82be-6b8ec128a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:15.724946 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1446/2904] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:15.734744 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:15.736536 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:15.767247 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:15.794075 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f09ab4-2275-4dfb-908e-4847ae0e4984 admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:15.797634 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:15.798270 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:15.798547 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:15.798819 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:15.808257 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:15.810113 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:15.819488 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1459/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:20.907490 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:20.907948 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:20.908044 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:20.947521 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] MFA Rules not processed for user `b1f96ff69658433ab596534282a3a2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:20.948871 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:21.029365 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1447/2906] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:21.030512 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.040525 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654690e1-d031-4e04-b20d-93d1ddfbfbbd service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.045124 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.052895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.052895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.052895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.052895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.052895 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.151058 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1460/2907] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 24 04:03:21 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:03:21.155171 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.166436 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527d45-c1a8-4fda-b646-cb786784e63b None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.228487 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.229049 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.229331 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.229606 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] PATH_INFO: `/v3/users` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.230280 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.232196 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.320776 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:21.326963 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1448/2908] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 24 04:03:21 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:03:21.331029 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.341718 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45b86-4235-4733-a145-59ce1f27d03a admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.346426 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.347114 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.347398 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.347673 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.348315 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.349912 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.362363 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1461/2909] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:03:21.367877 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.378465 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d4a45-3fa7-4940-ae32-490a2fa7a616 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.384803 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.385579 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.385925 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.386242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] PATH_INFO: `/v3/projects/213d34a338144b139fb21fc6f5c245a8/users/1a20f35acffc42a0a0f59e7e06ebb627/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.402725 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213d34a338144b139fb21fc6f5c245a8, user_id=1a20f35acffc42a0a0f59e7e06ebb627, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.406608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.481283 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1449/2910] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:03:21 2022] PUT /identity/v3/projects/213d34a338144b139fb21fc6f5c245a8/users/1a20f35acffc42a0a0f59e7e06ebb627/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:21.486304 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.498399 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f2fd9-19b1-4855-9c0d-cac4f55ade7c admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.556350 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.556954 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.557233 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.557504 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.558169 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.560102 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c540-b483-4ec2-b1ff-ea40ce086c0a admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.570119 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1462/2911] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 24 04:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:03:21.574318 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.585719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e254d-f760-4d26-81ff-91734d75d0d2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.591505 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.592213 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.592491 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.592762 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] PATH_INFO: `/v3/projects/213d34a338144b139fb21fc6f5c245a8/users/1a20f35acffc42a0a0f59e7e06ebb627/roles/15131bc73ffe4de98028e781cae256f3` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.594705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=213d34a338144b139fb21fc6f5c245a8, user_id=1a20f35acffc42a0a0f59e7e06ebb627, role_id=15131bc73ffe4de98028e781cae256f3)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.597369 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.608658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1450/2912] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 24 04:03:21 2022] PUT /identity/v3/projects/213d34a338144b139fb21fc6f5c245a8/users/1a20f35acffc42a0a0f59e7e06ebb627/roles/15131bc73ffe4de98028e781cae256f3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:03:27.296444 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43be9-e156-44cc-a723-31a1034d89c9 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:27.296977 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43be9-e156-44cc-a723-31a1034d89c9 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:27.298384 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43be9-e156-44cc-a723-31a1034d89c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:27.329195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-83c43be9-e156-44cc-a723-31a1034d89c9 None None] MFA Rules not processed for user `1a20f35acffc42a0a0f59e7e06ebb627`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:27.330638 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-83c43be9-e156-44cc-a723-31a1034d89c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:27.409458 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1463/2913] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:27.422697 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:27.424573 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:27.487982 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d1f21-787d-443c-914a-4b70568e45dc admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:27.491794 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7039ec3afcd41b7b006d1179e19cbc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:27.492400 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:27.492674 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:27.492943 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:27.553274 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:27.554933 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:27.565003 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1451/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:27.847200 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba9ae-8f31-4f3e-8624-3fd0dbaed3d3 None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:27.847485 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba9ae-8f31-4f3e-8624-3fd0dbaed3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:27.847757 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba9ae-8f31-4f3e-8624-3fd0dbaed3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:27.876204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:27.911401 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-692ba9ae-8f31-4f3e-8624-3fd0dbaed3d3 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:27.912636 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-692ba9ae-8f31-4f3e-8624-3fd0dbaed3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:27.978168 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1464/2915] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 04:03:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:28.142789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:28.144575 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:28.228713 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:28.237753 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e4e94-e5ed-442e-8ba5-8a6fb9be68c4 service glance] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:28.243771 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:28.244375 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:28.244658 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:28.244935 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:28.253289 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:28.254993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:28.264286 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1452/2916] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 04:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:03:37.974943 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=36 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:38.288659 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=7 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:38.696905 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] REQUEST_METHOD: `POST` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:38.697147 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:38.697448 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:38.717416 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.auth.core [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] MFA Rules not processed for user `b1f96ff69658433ab596534282a3a2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:38.718726 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:38.725930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1465/2917] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 24 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:38.982543 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:38.983992 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:39.043259 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29766a1e-0951-45bd-8cba-85193560b2d4 service swift] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:39.046920 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:39.047514 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:39.047789 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:39.048059 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:39.049779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:39.060696 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:39.062254 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5372-676f-4916-b1bd-f58f9d9d1430 service neutron] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:39.070612 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1453/2918] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:39.575844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:39.577452 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:39.651372 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abead-49a6-422f-809a-7fac36d2d4ca None None] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:39.656831 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:39.680290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:39.680290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:39.680290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:39.680290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:39.680290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:39.681293 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:39.684534 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1466/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:43.158990 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:43.164541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:43.164541 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:43.179090 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:43.180843 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:43.188316 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1454/2920] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 24 04:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:03:43.200685 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:43.212116 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc4978-e4ec-4ddc-8225-a8f38feb1b4a service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:43.217171 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:43.217756 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:43.218074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:43.218348 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:43.226380 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:43.228034 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:43.236926 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1467/2921] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 04:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:03:53.173878 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=29 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:53.233653 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=41 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:00.958957 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:00.960493 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:04:01.035103 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb2296-d8c8-4c57-89f5-fcceccaffc58 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:01.041207 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:01.041806 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:01.042115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:01.042496 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:01.044187 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:04:01.057781 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:01.059569 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:01.070698 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1455/2922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:04:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:04:10.099898 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:10.109172 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6341811-5a26-4058-b2e5-26106a02e836 service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:10.112731 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a8cbc422f14bd2b284402085ca7050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:10.113317 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:10.113592 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:10.113863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:10.123192 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:10.124607 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:10.133844 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1468/2923] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:04:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:04:11.066718 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=34 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:12.060200 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:12.062052 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:04:12.080885 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf0f7e-bcc5-4479-89c4-e96f20d36e99 service nova] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:12.086719 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39cdc5dd5bdc44379c4504de359775c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:12.087327 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:12.088140 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:12.088419 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:12.090208 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:04:12.102845 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:12.106993 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0011d8-7b25-43e1-aced-f0b15481fdd5 service nova] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:12.116006 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1456/2924] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:04:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:04:20.129739 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=6 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:22.111370 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=6 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:43.377802 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:43.439074 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be24361-3fa5-40b7-b4e8-75edb8bfe3f9 service neutron] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:43.444335 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:43.444930 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:43.445206 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:43.445477 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:43.447290 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:43.482467 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:43.484250 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:43.494274 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1469/2925] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:53.489856 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=36 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:43.774360 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] REQUEST_METHOD: `POST` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:43.774882 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:43.774985 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:43.794783 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.auth.core [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] MFA Rules not processed for user `64b7cf06c51045c1ab2ae0797f8dd08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81741) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:43.795965 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:43.804223 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1457/2926] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 24 04:06:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:43.843598 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:43.855591 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf563e-e140-4bf9-ae06-29e1dd98fc12 service placement] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:43.860630 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eced38ac42be41fa8aa9be12ca4ebde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:43.861222 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:43.861502 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:43.861779 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:43.870044 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:43.871616 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:43.879656 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1470/2927] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 24 04:06:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:06:48.367711 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:48.369115 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:48.384566 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd4bf-ace9-4639-b2a3-d54f45495e28 None None] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:48.389601 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:48.390242 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] REQUEST_METHOD: `GET` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:48.390523 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:48.390798 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:48.392623 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:48.404336 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:48.406065 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:48.416234 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1458/2928] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:52.289144 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:52.370388 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17f0f3-1d05-4a8b-a19e-8e66c2eb461c service swift] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:52.374941 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:52.375554 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:52.375829 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:52.376099 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] PATH_INFO: `/v3/users/b1f96ff69658433ab596534282a3a2ea` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:52.377195 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f96ff69658433ab596534282a3a2ea)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:52.379208 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:52.560271 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f96ff69658433ab596534282a3a2ea'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:52.560890 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f96ff69658433ab596534282a3a2ea'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:52.567775 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f96ff69658433ab596534282a3a2ea'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:52.568411 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f96ff69658433ab596534282a3a2ea'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:52.580964 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f96ff69658433ab596534282a3a2ea'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:52.661863 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1471/2929] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:06:52 2022] DELETE /identity/v3/users/b1f96ff69658433ab596534282a3a2ea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:06:52.909958 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:52.921417 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312577bb-d428-423f-9c2f-c13fffd2e9c3 service placement] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:52.984089 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:52.984779 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:52.985092 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:52.985366 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] PATH_INFO: `/v3/projects/3a06de4e61a34824800174b12ce9d3c8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:52.986499 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a06de4e61a34824800174b12ce9d3c8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:52.988621 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:53.096311 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a06de4e61a34824800174b12ce9d3c8', 'request_id': 'req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.101804 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a06de4e61a34824800174b12ce9d3c8', 'request_id': 'req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.108045 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a06de4e61a34824800174b12ce9d3c8', 'request_id': 'req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.251038 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] The token cache is being invalidate because project 3a06de4e61a34824800174b12ce9d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:06:53.251255 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.251856 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.253345 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1459/2930] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:06:52 2022] DELETE /identity/v3/projects/3a06de4e61a34824800174b12ce9d3c8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:06:53.257469 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:53.258916 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:53.271786 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50e65-d526-45da-ab9b-222d4fd24fde admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:53.319672 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:53.333622 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:53.334402 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:53.334862 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:53.335180 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] PATH_INFO: `/v3/users/1a20f35acffc42a0a0f59e7e06ebb627` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:53.336519 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a20f35acffc42a0a0f59e7e06ebb627)` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:53.338763 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:53.555700 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a20f35acffc42a0a0f59e7e06ebb627'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.556277 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a20f35acffc42a0a0f59e7e06ebb627'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.563395 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a20f35acffc42a0a0f59e7e06ebb627'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.564031 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a20f35acffc42a0a0f59e7e06ebb627'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.576445 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.notifications [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a20f35acffc42a0a0f59e7e06ebb627'} {{(pid=81740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:53.657066 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1472/2931] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 24 04:06:53 2022] DELETE /identity/v3/users/1a20f35acffc42a0a0f59e7e06ebb627 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:06:53.936033 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Authenticating user token {{(pid=81741) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:53.937608 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.fernet_utils [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81741) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:53.951243 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8d5de-2787-46c8-bb7c-4c4f187c64e2 admin admin] Validating token access rules against request {{(pid=81741) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:54.008000 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04db7b67b37f41558e8d4c57ad2b3f70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcc2c09443be4848acb9a6d8fb8bb990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81741) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:54.008628 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:54.008909 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:54.009184 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] PATH_INFO: `/v3/projects/213d34a338144b139fb21fc6f5c245a8` {{(pid=81741) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:54.010362 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=213d34a338144b139fb21fc6f5c245a8)` {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:54.012265 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] RBAC: Authorization granted {{(pid=81741) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:54.013705 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:54.125867 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213d34a338144b139fb21fc6f5c245a8', 'request_id': 'req-d0d07466-1873-4106-bc58-db2e124d9e7b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:54.132656 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213d34a338144b139fb21fc6f5c245a8', 'request_id': 'req-d0d07466-1873-4106-bc58-db2e124d9e7b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:54.138763 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213d34a338144b139fb21fc6f5c245a8', 'request_id': 'req-d0d07466-1873-4106-bc58-db2e124d9e7b'} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:54.207188 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] The token cache is being invalidate because project 213d34a338144b139fb21fc6f5c245a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81741) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:06:54.207481 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:54.208165 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG keystone.notifications [None req-d0d07466-1873-4106-bc58-db2e124d9e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81741) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:06:54.209668 dv-cinder-854259-1-smb devstack@keystone.service[81741]: [pid: 81741|app: 0|req: 1460/2932] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 24 04:06:53 2022] DELETE /identity/v3/projects/213d34a338144b139fb21fc6f5c245a8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:07:03.652866 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:04.204080 dv-cinder-854259-1-smb devstack@keystone.service[81741]: DEBUG dbcounter [-] [81741] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81741) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:49.388537 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Authenticating user token {{(pid=81740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:10:49.389959 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:10:49.458204 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fa0-034f-4594-92de-e7a55dc9bd0d admin admin] Validating token access rules against request {{(pid=81740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:10:49.515371 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cdd101e8d840be856ace9511917a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f090099f7a4443abba863c4002872264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:10:49.515965 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] REQUEST_METHOD: `GET` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:49.516245 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] SCRIPT_NAME: `/identity` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:49.516516 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:49.518246 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.fernet_utils [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:10:49.529608 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:10:49.531220 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe76d8-d445-4425-9071-805715dd1ca8 service placement] RBAC: Authorization granted {{(pid=81740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:10:49.542194 dv-cinder-854259-1-smb devstack@keystone.service[81740]: [pid: 81740|app: 0|req: 1473/2933] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 24 04:10:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:10:59.537542 dv-cinder-854259-1-smb devstack@keystone.service[81740]: DEBUG dbcounter [-] [81740] Writing DB stats keystone:SELECT=58 {{(pid=81740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}